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Preface 


The present manuscript is intended to be a textbook that could serve both 
undergraduate and graduate students when studying Fuzzy Set Theory and 
Applications. It is also intended to deepen the research into some existing 
directions and to investigate some new research directions. The book tries 
to develop a systematic, Mathematically-based introduction into the theory 
and applications of fuzzy sets and fuzzy logic. In this way the author tries 
to cover a gap in the literature. Also, the book can be an introduction into 
Fuzzy Sets and Systems for researchers who are interested in the topic of 
fuzzy sets in all areas of Mathematics, Computer Science and Engineering, 
or simply interested Mathematicians, Engineers and students in these areas. 
The book starts from the basic theory and gets the reader to a level very 
close to the current research topics in Fuzzy Sets. 

The basis of the book is the author’s class notes for Fuzzy Sets and Fuzzy 
Logic, class taught at DigiPen Institute of Technology. 

Another goal that the author had when writing the present book is try to 
see where Fuzzy Sets and Fuzzy Logic as a discipline, can be connected to 
other areas of Mathematics. The manuscript tries to show that Fuzzy Sets 
is an independent discipline having huge overlaps on one side with Analysis 
and Approximation Theory and on the other side with Logic and Set Theory. 
The approach of the present work leans toward Mathematical Analysis and 
Approximation. 

Tam really thankful to my wife Emese, who provided very strong support 
for me in writing this book. Also, the author is thankful to his colleagues, es- 
pecially Sorin G. Gal, L. Stefanini, L.C. Barros, I.J. Rudas and many others 
for comments that improved the manuscript. The author would like to express 


Vill Preface 


his thanks to all the students who contributed with comments that improved 
the manuscript, especially Kia McDowel, Matt Peterson, Chris Barrett, and 
many others. 


Barnabas Bede 
Redmond, WA 
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1 
Fuzzy Sets 


1.1 Classical Sets 


The concept of a set is fundamental in Mathematics and intuitively can be 
described as a collection of objects possibly linked through some properties. 
A classical set has clear boundaries, i.e. x € A or x ¢ A exclude any other 
possibility. 

Definition 1.1. Let X be a set and A be a subset of X (AC X). Then the 
function 

_f 1 of wea 

xale)={ 4 if GA 


is called the characteristic function of the set A in X. 


Classical sets and their operations can be represented by their characteristic 
functions. 

Indeed, let us consider the union AU B = {x € X|x € Aor rE B}. Its 
characteristic function is 


XauB(2) = max{x4(z), xB (x)}. 
For the intersection AN B = {x € X|x € A and a € B} the characteristic 
function is 
XanB(£) = min{xy a(x), xB(x)}- 
If we consider the complement of A in X , A = {x € X|x ¢ A} it has the 
characteristic function 
xA(@) =1— xa(z). 
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2 1 Fuzzy Sets 


1.2 Fuzzy Sets 


Fuzzy sets were introduced by L. Zadeh in [154]. The definition of a fuzzy set 
given by L. Zadeh is as follows: A fuzzy set is a class with a continuum of 
membership grades. So a fuzzy set A in a referential (universe of discourse) 
X is characterized by a membership function A which associates with each 
element z € X areal number A(z) € [0,1], having the interpretation A(x) is 
the membership grade of x in the fuzzy set A. 


Definition 1.2. (Zadeh [154) A fuzzy set A (fuzzy subset of X ) is defined 
as a mapping 
A:X (0,1), 


where A(x) is the membership degree of x to the fuzzy set A. We denote by 
F(X) the collection of all fuzzy subsets of X. 


Fuzzy sets are generalizations of the classical sets represented by their char- 
acteristic functions y4 : X — {0,1}. In our case A(x) = 1 means full mem- 
bership of x in A, while A(x) = 0 expresses non-membership, but in contrary 
to the classical case other membership degrees are allowed. 

We identify a fuzzy set with its membership function. Other notations that 
can be used are the following .4(%) = A(x). 

Every classical set is also a fuzzy set. We can define the membership func- 
tion of a classical set A C X as its characteristic function 


(ix 1 if reEA 
Hae) 6 otherwise 


Fuzzy sets are able to model linguistic uncertainty and the following examples 
show how: 


Example 1.3. In this example we consider the expression “young” in the 
context “a young person” in order to ecemplify how linguistic expressions can 
be modeled using fuzzy sets. The fuzzy set A : [0,100] > [0,1], 


1 if O<a< 20 
A(z) =¢ 452 if 20<2< 40 
0 otherwise 


is illustrated in Fig. 


Example 1.4. Let us consider the fuzzy set A: R > [0,1], A(x) = oar 
This fuzzy set can model the linguistic expression “real number near 0” (see 


Fig. (£2). 


Example 1.5. If given a crisp parameter which is known only through an 
expert’s knowledge and we know that its values are in the [0,60] interval, the 
expert’s knowledge expressed in terms of estimates small, medium, and high 
can be modeled, e.g. by the fuzzy sets in Fig. 
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Young Person 


T 
i} 10 20 30 40 50 60 70 80 90 100 


Fig. 1.1 Example of a fuzzy set for modeling the expression young person 


Near Zero 


ze 
<x 


Fig. 1.2 Fuzzy set that models a real number near 0 


Example 1.6. Fuzzy sets can be used to express subjective perceptions in 
a mathematical form. Let X = [40,100] be the interval of temperatures for 
a room. Fuzzy sets A,, Ag,...,As5 can be used to model the perceptions: cold, 
cool, just right, warm, and hot (see Figure[1.4): 

cold: 


1 if 40<a2<50 
Ai(z)=¢ Se if 50<2< 60 
0 if 60<a2<100 


4 1 Fuzzy Sets 
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Fig. 1.3 Expert knowledge represented by fuzzy sets 


cool: 
0 if 40<2<50 
2-50 if 50<2< 60 
a 0 = 
Ao(z)=) We if 60<2<70 
0 if 70<a< 100 
hot: 
0 if 40<2<80 
As(z)=4 SS if 80<a2<90 


1 if 90<2<100 


Definition 1.7. Let A: X — [0,1] be a fuzzy set. The level sets of A are 
defined as the classical sets 


Ag = {x € X|A(x) > a}, 


O0<a<l. 
A; = {x € X|A(x) > 1} 


is called the core of the fuzzy set A, while 
supp A = {x € X|A(x) > 0} 


is called the support of the fuzzy set. 
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z 4 
= 05 


Fig. 1.4 Fuzzy sets Cold, Cool, Just Right, Warm and Hot used in a room tem- 
perature control example 


Example 1.8. Let us consider the cool fuzzy set as in the previous example. 


0 if, 40<2<50 
2-50 if 50<2 <60 


— 10 
An(z)=) 1 (260 if 60<2 <70 
0 if 70<«< 100 


Its core is (Az); = {60}, the 4-level set is (Az)1 = [55,65], the a-level set is 
(A2)a = [50+10a, 70—10a],0 < a < 1 and the support is supp Az = (50, 70). 


Remark 1.9. If the universe of discourse is a finite set X = {x1,%2,...,Ln} 
then a fuzzy set A: X — [0,1] can be represented formally as 

A(x A(x A(&n 

Aa Ay) , Al@2) , An) 
Ty v2 rn 

Example 1.10. Let us consider the expression “good grade in Mathematics”. 
This expression can be represented as a fuzzy set GG: {A, B,C, D, F} = (0, 1], 
G= rT + oF + 93 + + + a. The core of G is G, = {A}, the support is 
supp G = {A, B,C} and the 4- level set is Gi = {A, B}. 


1.3. The Basic Connectives 


Let F(X) denote the collection of fuzzy sets on a given universe of dis- 
course X. 


6 1 Fuzzy Sets 


The basic connectives in fuzzy logic and fuzzy set theory are inclusion, 
union, intersection and complementation. 

In fuzzy set theory these operations are performed on the membership 
functions which represent the fuzzy sets. When Zadeh [154], introduced these 
connectives, he based the union and intersection connectives on the max and 
min operations. Later they were generalized and studied in detail. 


1.3.1 Inclusion 


Let A,B € F(X). We say that the fuzzy set A is included in B if 
A(x) < B(x), Va € X. 


We denote A < B. The empty (fuzzy) set @ is defined as O(a) = 0, Vr € X, 
and the total set X is X(x) =1, Va € X. 


1.3.2 Intersection 


Let A, B € F(X). The intersection of A and B is the fuzzy set C with 
C(a#) = min{ A(x), B(x)} = A(x) A B(x), Va € X. 
We denote C= AA B. 


1.3.38 Union 


Let A,B € F(X). The union of A and B is the fuzzy set C, where 
C(x) = max{A(a), B(x)} = A(x) V B(x), Va € X. 
We denote C= AV B. 


1.3.4 Complementation 


Let A € F(X) be a fuzzy set. The complement of A is the fuzzy set B 
where 
B(x) =1- A(az), Vr € X. 


We denote B = A. 


Remark 1.11. We observe that the operations between fuzzy sets are defined 
point-wise in terms of operations on the [0,1] interval. Also, let us mention 
here that throughout the text we will use the following notations min{z, y} = 
xAy, max{z,y}=2Vy with operands x,y € [0,1] or x,y € R. Also, without 
the danger of a major confusion we use the notations AA B and AV B to 
denote the intersection and union of two fuzzy sets. 


1.3. The Basic Connectives “ 


Example 1.12. If we consider the fuzzy sets 


if 40<2<50 
if 50<«<60 
if 60<x< 100 


2 


if 40<2<50 
if 50<«<60 
if 60<2<70 
if 70<«<100 


given in Example[L.@| then their union is 


Ai A Ao(x) = 


The complement of A, can be written 


see Figs. 


0 if 
“a C 
1 if 


if 40<a2<50 
if 50<a2<55 
if 55<a«<60 
if 60<a2<70 
if 70<2x< 100 
if 40<a2<50 
if 50<a<55 
if 55<a«<60 
if 60<2x< 100 
40 <x < 50 

50 <a < 60 

60 < x < 100 


Example 1.13. If the universe of discourse is a discrete set X = {21, 22, 
w+yUn} then the union intersection and complementation can be easily ex- 
pressed. If A,B: X — [0,1], they can be represented as 


A= 


B= 


Then the union is 


AVB= 
Ty 


the intersection is 


ANB= 
Ty 


A(21) V B(a1) 


A(21) \ B(a1) 


A(21) 


Ty 


Bay a: 


Ty 


A(a2) 


XQ 


Z2 


x2 


Z2 


B(x2) 


A(2n) 
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Fig. 1.5 Fuzzy Intersection 


A(x) 
° 
a 

L 


Fig. 1.6 Union of two fuzzy sets 


and the complement of A is 


1 — A(a1) 4: 1 — A(x) eae 1- A(tn) 


Ty x2 In 


A= 


Example 1.14. Consider X = [0,00] and the fuzzy sets A(x) = 77, B(x) = 


aT" Then we can illustrate AV B, AA B and A as in figs. [9 
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A 
70 80 90 100 


Fig. 1.8 Two fuzzy sets A and B 


1.4 Fuzzy Logic 


Proposition 1.15. (see e.g., Dubois-Prade [51]) Considering the basic con- 
nectives in fuzzy set theory, the following properties hold true: 


10 1 Fuzzy Sets 


1. Associativity 


2. Commutativity 


ANB=BAA 
AVB=BVA 
3. Identity 
ANAX=A 
AVQ=A 
4. Absorption by 0 and X 
ANO=0 
AVX =X 
5. Idempotence 
ANA=A 
AVA=A 
6. De Morgan Laws 
ANB=AV 
AVB=AA 


T ; ; , T T 
0 1 2 3 4 5: 
x 


Fig. 1.9 Basic connectives for the fuzzy sets A and B 
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7. Distributivity 


8. Involution 


9. Absorption 
AA(AVB)=A 
AV(AAB)=A 


Proof. The proofs of properties 1-5, 7, and 8 are left to the reader. 
Let us prove the first De Morgan law in 6. Let « € X. Then 


AA B(x) =1—min{A(z), B(x)} 
= max{1— A(z),1— B(x)} = AV B(a). 


Let us also prove one of the absorption laws in 9: AV(AA B) = A. Let x € X. 
Then we have 


x) = A(x) V (A(x) A B(ax)) < A(x) V A(z) 
= A(x) < A(x) V (A(x) A B(a)). 
| 


The algebraic structure obtained in this way is called a distributive pseudo- 
complemented lattice. 

Let us remark that the laws of contradiction and excluded middle (“tertio 
non datur”) fail. More precisely: 


Proposition 1.16. If A is a non-classical fuzzy set A: X — [0,1] (we., 
there exists x © X with A(x) €¢ {0,1}) then 


A\NA#FO 

AVAFX. 
Proof. If « € X is such that 0 < A(x) < 1 then 0 < A(x) < 1 and then 
0<AAA(x)<land0< AV A(a) <1. rT] 


So, if we allow gradual membership for fuzzy sets, then the algebraic structure 
is incompatible with the Boolean algebra structure which is at the basis of 
classical set theory and classical logic. As a conclusion, we need a different 
theory. This theory is the theory of fuzzy sets and fuzzy logic. 


1.5 Problems 


1. Set up membership functions for modeling linguistic expressions about 
the speed of a car on a highway: “very slow”, “slow”, “average”, “fast”, 
“very fast”. 


12 


. Consider uae fuzzy sets A,B : R, — [0,1] defined as A(x) = 


1 Fuzzy Sets 


Consider the fuzzy sets A,B : ae reo => [0,1 co . A(x) = 
i a ea +2494 5, Br) = 949494 84 
bs "08 yh 4 bs p02 4 +'2,. Caleulate AN B, AV B, A,B BCaleulate 
and compare AV B aa AAB. 


1 
pieg T+2?) 
B(a) = zz. Calculate AA B, AV B, A, B and graph them. 


. Consider the fuzzy sets 


0 if, a<l 

al if 1<a2<7 
At)=9 wee if 7<2<10 ’ 
0 if W<e 


0 if, r<2 
a-2 if 2<2<3 
B(x) = 1 if 83<a<4 . 
Se if 4<2<6 
0 if 6<2 


Find AA B, AV B, A and graph them. 


. Prove the properties 1-5, 7,8 in Proposition [1.15] 


. Prove that for any fuzzy set A € F(X) we have 


AVA>0O.5, 


while 


ANA<0O.5. 


. Prove that for any fuzzy sets A, B € F(X) we have 


(AA B)v (AA B) > 0.54 (AV B)A(AVB) 


and 


(AV B)A (AV B) <0.5V(AA B)V(AAB). 


2 
Fuzzy Set-Theoretic Operations 


2.1 Negation 


As we have seen in the previous section, we can identify the operations be- 
tween fuzzy sets by the corresponding operations on the unit interval, fuzzy 
set operations being defined point-wise. This implies that we can study oper- 
ations between fuzzy sets by the corresponding operations over the real unit 
interval. 


Definition 2.1. (Trillas [147], see also Fodor-Roubens [60)) A function 
N : [0,1] — [0,1] ts called a negation if N(0) = 1, N(1) = 0 and N is 
non-increasing (x < y= N(a) > N(y)). A negation is called a strict nega- 
tion if it is strictly decreasing (x < y = N(x) > N(y)) and continuous. A 
strict negation is said to be a strong negation if it is also involutive, i.e. 
N(N(a)) = 2. 


Definition 2.2. If Ac F(X) is a fuzzy set then the N—complement of A 
is defined point-wise as N(A)(x) = N(A(a)). 


Example 2.3. The standard negation is N(x) =1-— 2, and it is a strong 
negation. 


l—-a 


Example 2.4. The negation Ny(x) = 7G; 


called the A-complement. 


A > —-1, is a strong negation 


Remark 2.5. An alternative notation for any negation N(x) is Z. 


In the following theorem, strong negations are characterized: 
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Theorem 2.6. (Trillas [1/7]) A function N : [0,1] > [0,1] is a strong 
negation if and only if there exists an automorphism (continuous invertible 
function y : [0,1] + [0,1] with continuous inverse y+) such that 


N(x) = y*(1— 9(2)). 


Proof. “ >” If n is a strict negation then f(a) = N(x) — x is continuous, 
f(0) =1, and f(1) = —1. In which case there exists an «* € (0,1) such that 
f(x*) =0, or equivalently, N(a*) = x*, ie., N has a fixed point. 

Now let Ni, No be two strict negations. Then there exist 51,52 € (0,1) 
such that Ni(s1) = s1and No(s2) = s2. Let t = Pm and y,w: [0,1] > [0, 1], 


7 if xr< so 
v(x) = Ne (2) if 2> sq’ 


_ tx if x< sy 
v(2) = { No (tN; *(z)) if r>s,° 


We claim that No = yo N, 0 gy. Indeed, if  < sg then | < # = 81, and 
Ni (2) = Ni(s1) = §}. We have 
x 
Yo Noe(e) = ¥(M(5)) 
_ x x 
= Nalt- Nz*(Ni(=))] = Na (t- =) = Nala). 


If a > sq then No(x) < No(s2) = s2 = sit. Then we obtain Natsa) < s,. We 


have peineea (x (a7? (="))) 


=» (=) ag.) 7). 


t 


As a conclusion we obtain 70 N,0o py = No. Let N; be the standard negation 
N(x) =1-— 2. Then 


(x) 7 if x< so 
ve 1 — Sate) if x2> so 
tx if a<t 
wo ={ N2(t(1—2)) if a> 
and t = 2589. 
If x < so then $< 2 = 4, ie., v(x) < 4 and then we have 
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If a > sg then No(ax) < No(s2) = s2 and we obtain 1 — Me) >1-2= 4, 
i.e., p(x) > 4. Taking these into account we have 


Bo ple) = Nalt(t ~ g(a) = Na (¢(E)) = watna(e), 


If No is a strong negation then N2(No(x)) = 2, ie., yo y(a) = x andasa 
conclusion ~ op = 1jo.1] 

Now, let us calculate y o @. 

If c < $ then at < § = 589, ie, ¥(z) < $. Then yo (2) = y(at) = 
=f. 

If x > 4 then l-—a < 4, 
No(s2) = SQ. Then 


then t(1 — x) < $ = 82 and No(t(1 — 2)) > 


god(z) = y(Na(t(1 — 2))) =1- ee 


If Nz is a strong negation we get 


gow(e)=1- = 9) =f 


The continuity of and 7 is easy to be checked and we obtain po ~ = 1j,1), 
ie., y and w are inverses of each other (7 = y~*). 

As a conclusion if N is a strong negation then there exists an automor- 
phism ¢ : [0,1] — [0,1], such that N(x) = y-1(1 — y(a)). 

“<” Now given ¢, an automorphism of [0,1], we consider N(x) = y~!(1— 
y(x)). Then N is obviously continuous. Also, 


N(0) =~ "(1 — 9(0)) = 9") = 1 


N(1) = ¢ '(1- v(1)) = » *(0) = 0, 
and 
N(N(2)) = 9 *(1- oe" - ¢(2)))) 


=p 1(1-1+9(2)) = 9" (y(a)) =«. 


To show that N is strictly decreasing, we observe that y is increasing, 1 —y is 
decreasing and y~! is increasing. Then y~'(1 — ¢y(a)) is strictly decreasing. 
As a conclusion N is a strong negation. | 


Remark 2.7. N(x) = y~1(1—¢y(z2)) is called the p-transform of the standard 
negation. 


Example 2.8. A very popular parametric family of strong negations is N(x) = 
(1— 2%), for any a € (0,00). 
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2.2 Triangular Norms and Conorms 


Triangular norms and conorms generalize the basic connectives between fuzzy 
sets. They were first introduced in the theory of probabilistic metric spaces. 
Later these were found to be very suitable to be used with fuzzy sets. 


Definition 2.9. (Schweizer-Sklar [130)) Let T,S : [0,1]? > [0,1]. Consider 
the following properties: 
T,: T(#,1) =~ (identity) 


S,: S(#,0) =2 

T2: T(x, y) =T(y, x) (commutativity) 

So: S(x,y) = Sly, 2x) 

T3: T(«,T(y,z)) =T(T(2,y), z) (associativity) 
$2: S(e, S(y,2)) = 9(S(@,y),2) 


Ty: Ife<uandy <v then T(ax,y) < T(u,v) (monotonicity) 

S4:Ifa<uandy <v then S(x,y) < S(u,v) 

A triangular norm (t-norm) is a function T : [0,1]? > [0,1] that satisfies 
T, — T4. 

A triangular conorm (t-conorm or s-norm) is a function S : [0,1]? 


(0, 1] that satisfies S, — S4. 
We will occasionally use the notation «Ty = T(x, y), eSy = S(a,y). 


Definition 2.10. Given T,S : [0,1]? > [0,1] a t-norm and a t-conorm, for 
fuzzy sets A,B € F(X) we define operations point-wise 


AT B(«) = A(x)T B(a) 
AS B(x) = A(x) S'B(a) 


for any x € X. 


Proposition 2.11. Given any t-norm T and t-conorm S, we have T(x, 0) 
= 0 and S(#,1) =1, for all x € [0,1]. 


Proof. From T; we have T(0,1) = 0. Then from T4 it follows that 
T(0,z) < T(0,1) = 0,Vz € (0, 1], 


i.e., T(0,2) = 0. Then from Tz we get T(x, 0) = 0. 
Similarly, we have $(1,0) = 1 so, 


1 = S(1,0) < S(1,2), 
and then S(1,2) = 1 = S(x,1), Vx € [0,1]. rT] 


Proposition 2.12. We have T(x,y) < «Ay and S(a,y) > «Vy for any 
t-norm T, t-conorm S,, and any x,y € (0, 1]. 
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Proof. We have 
T (x,y) <T(a,1) =<. 


Also, 
T(z,y) =Tly, 2) <T(y,1) =y. 


As a conclusion T(2,y) < «aA y. Similarly, S(x,y) >a Vy. a 


The connection between t-norms and t-conorms is made by strong negations 
as follows. 


Definition 2.13. (Zadeh [154\) A triplet (S,T,N) is called a De Morgan 
triplet if T is a t-norm, S is a t-conorm, N is a strong negation, and if they 
fulfill De Morgan’s law 


S(a,y) = N(T(N(«), N(y)))- 


Remark 2.14. If (S,T,N) is a De Morgan triplet then we have T(x,y) = 
N(S(N(a), N(y))). Indeed, 


Then 
N(S(N(z), N(y))) = NN (F(z, y)) = P(e, y). 


In what follows we give some examples of De Morgan triplets. 


Example 2.15. (Zadeh [754]) The minimum and maximum 


xAy=min{z, y} 
xVy =max{z, y} 


together with the standard negation N(x) = 1— 2, form a De Morgan triplet. 
This De Morgan triplet (often called Godel t-norm and t-conorm) plays a 
special role in fuzzy logic, and it was proposed to be used for fuzzy sets by 
Zadeh in [754]. Let us also observe that A is the greatest t-norm and \V is the 
least t-conorm as it was shown in Proposition [2.1] 


Example 2.16. (see e.g., Fodor-Roubens [60]) The product and the proba- 
bilistic sum 


tIey=x-y 
uSey=xt+y-—xy 


together with the standard negation N(x) = 1— 2, form a De Morgan triplet. 
These are called Goguen’s t-norm and t-conorm. 
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Example 2.17. (Hajek [76/)The Lukasiewicz t-norm and t-conorm 


cTry =(«+y—-1)V0 
rSpy =(x@t+y)Al 


together with the standard negation N(x) =1-— 2, form a De Morgan triplet 
that plays a very special role in fuzzy logic, and the algebraic structure over 
the [0,1] interval generated by these operations is called an MV algebra (MV 
stands for Multivalued, see Cignoli-D’Ottaviano-Mundici, [38), Di Nola-Lettieri 


[£1], Hajek [76]). 


Example 2.18. (see e.g., Fodor [59)) The nilpotent minimum and nilpotent 
maximum with the standard negation is a De Morgan triplet: 


_ jf cAyifety>1 
i a { 0 otherwise 


_ jf «aVyifety<l1 
Soy = { 1 otherwise 


These were introduced by Fodor and Perny and led to the study of similar fuzzy 
operations called uninorms and absorbing norms Rudas-Pap-Fodor [128]. 


Example 2.19. (see e.g. Klement-Mesiar-Pap [87]) The drastic product and 
sum with the standard negation is a De Morgan triplet: 


_ jf tAyifxVy=1 
eTpy a 0 otherwise 

_ J eVyifxAy=0 
“Spy -{ 1 otherwise 


This pair is also very important, because T’p is the least t-norm and Sp is the 
greatest t-conorm. Therefore, Tp <T <A andV <S< Sp for any t-norm 
T and t-conorm S. 


Example 2.20. (see e.g. Klement-Mesiar-Pap [89/) There are several para- 
metric families of t-norms and t-conorms. Perhaps the most famous one is 
the Frank family: 


© _1)(s¥—1 
xTpy = log, (1 + ee) 


oSpy =1—(1—«)Tp(1 — y), 


where s € (0,00) \ {1}. By definition Frank’s t-norm and t-conorm form a 
De Morgan triplet with the standard negation. The importance of these lies 
in the fact that they satisfy the functional equation 


aTpy+acSpy=x+y. 


2.3. Archimedean t-Norms and t-Conorms 
2.3 Archimedean t-Norms and t-Conorms 
Let T be a t-norm and S be a t-conorm. Given x € [0,1] we define 


oh) =F '(:234..50)) =T(c?), 2), n>2 


n—times 


a) = S(a,..,2) = S(ef-, 2), n 2 2. 


n—times 
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Definition 2.21. (see e.g. Klement-Mesiar-Pap [90], Fodor [59/) (i) A t- 
norm T (and respectively a t-conorm S) is said to be continuous if it is 


continuous as a function on the unit interval. 


(ii) A t-norm T and respectively a t-conorm S is said to be Archimedean 


if 
: (mn) _ 
ee 
and respectively 


s(n) 
i 


7 


for any x € (0,1). 


Proposition 2.22. (i) If T is Archimedean then T(x, x) < x,Vx € (0,1). 


(ii) If S is Archimedean then S(x,x) > x,Vax € (0,1). 


Proof. (i) Suppose the contrary, i.e., that a?) = T(x,xz) > «x for some 


x € (0,1). Then we have 
ov =TCOn HT aa) >s 
and by induction we also have 


ah”) =P 25.50) Sa. 


n—times 


Then limy_+o6 a ) > «x, which is a contradiction. 
(ii) The proof of (ii) is similar. 


Remark 2.23. Generally an Archimedean t-norm (or t-conorm) does not 
need to be continuous. If a t-norm (or t-conorm) is continuous and 


Archimedean then we obtain the following characterization: 


Theorem 2.24. (i) Let T be a continuous t-norm. Then T is Archimedean 


if and only af 
T(x,x) < x2,Vzx € (0,1). 


(ii) Let S be a continuous t-conorm. Then S is Archimedean if and only 


if 
S(a,x2) > 2,Vax € (0,1). 
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Proof. (i) “=” If T is Archimedean then the previous proposition ensures 
the property T(z, x) < x,Vzx € (0,1). 

“<=” Let us suppose now that T fulfills the condition T(a,2) < x,Vx € 
(0,1) and that T is continuous. Then we have 


a”) =T(a,..,.0) =T(T (2,2), Cyt )KL( Gy eh Jaane, 


n—times n—2—times n—1—times 


so the sequence a is decreasing (strictly). Also, a” ) is bounded from below 


by 0. So, a) is a convergent sequence. Let y = limy_+oo ao), Let us suppose 
now that y > 0. Then 

on) — T (2, 2) 
and since JT is continuous we have 


pence gta Or or) = PRE Oe aoe 


Taking into account that limp. en) is also y, we get y = T(y,y). But 


from the hypothesis, T(y, y) < y, so we get a contradiction. 
(ii) The proof of (ii) is similar. a 


Example 2.25. The product t-norm Tg(a,y) = x-y is Archimedean, while 
the min t-norm Ty (a2,y) =x Ay is not Archimedean. 


Definition 2.26. (Klement-Mesiar-Pap [89]) Let f : [a,b] + [c,d] be mono- 


tonic, and [a,b], [c,d] C [—o0, co]. The pseudo-inverse of f is defined as 
f  : [ed] > [a,5], 


sup({a| f(x) <y}Uf{a}) if fla) < f() 
FV) = 4 sup({2lf(z) > y}U {a}) if fla) > fb) 
a if f(a) =f) 
Example 2.27. Let f : [-1,1] > [c,d], [1.5,2.5] c [e,d], and f(z) = 34. 
Then we have 
f(y) = max{min(2y — 4,1), —1}. 
Indeed, first we observe that the image of the function f, denoted by Im(f) 
is Im(f) = f[-1,1] = [1.5, 2.5]. Then 


FPy) =oup fee 1,14 <ybu ty 


= sup{x € [-1, l]|a < 2y — 4} U {-]}. 
If 2y—4 < —1 then f(y) = -1. If-1 < 2y—4 < 1 then f(-Y(y) = 2y—4. 
If1 <2y—4 then f(y) =1. 
Also we observe that 
st af Bye ae 
max{min(2y—4,1),-l}= 4 2y—4 if -1l<2y-4<1 
1 if 1<2y-4 
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Lemma 2.28. Let f : [0,1] > [0,00], f(1) = 0 be strictly decreasing and 
continuous. Then 


fYy) = { f-*(y) of ys f(0) 


0 otherwise 


where f—' denotes the inverse function for the restriction f : [0,1] + Im(f). 


Proof. Indeed, Im(f) = [0, f(0)], and f is invertible on Im(f) having its 
inverse f—!. Then if y € Im(f), 


fy) = sup{a| f(x) > y} = sup{e| f(x) > f(F-(@))} 


= sup{z|x < f—*(y)} = f-*(y). 


If y > f(0) then f(x) > y > f(0) — > x < 0. Then sup{z € [0, 1]| f(x) > 
} = and then sup{z|f(x) > y} U {0} =0. : 


Lemma 2.29. If f : [0,1] — [0,00] is decreasing then 
(i) f-YV(F(@)) = 
(ii) f(f—) (@)) = min{z, f(0)}. 
Proof. Since f(x) < f(0 } we have f(-)(f(x)) = (x)) =a. 
Ifa < f(0) then f(f-)(x)) = f(f-'(z)) =a. Ife > f(0) then f(z) = 
O,and so f(f—!)(a)) = f(0) = 


Lemma 2.30. (see Aczél [7J) The only continuous solution F : R > R of 
Cauchy’s functional equation 


F(a +y) = F(a) + F(y) 


is F(x) = cx, for some constant c € R. 


Proof. We have F'(0) = 2F(0), and so F'(0) = 0. Then, F(n) = nF(1). Let 
F(1) =c. It is easy to prove that F(4) = “ and then F() = ™F(1), i., 
F(r) =cr,Vr € Q. Then we extend F' by continuity and we get F(a) = cx 
for any x ER. | 


Theorem 2.31. (Representation of Archimedean t-norms, see e.g. 
Klement-Mesiar-Pap, [87], Klement-Mesiar-Pap, [88)) For a continuous func- 
tion T : [0,1]? — [0,1] the following statements are equivalent: 


(i) T is a continuous Archimedean t-norm 

(ii) T has a continuous additive generator, i.e., there is a continuous 
strictly decreasing t : [0,1] > [0, co], t(1) = 0, which is uniquely determined 
up to a multiplicative constant such that for all x,y € [0,1] we have 


T(x,y) =t— (t(a) + ty). 
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Proof. (ii)=>(i). Let T(a, y) = t~)(t(x) + t(y)). We have to prove that it is 
a continuous Archimedean t-norm. 

T1: From the previous lemma we get T(x,1) = t@-Y(t(a) + t(1)) = 
t'-D(t(x)) = 2. 

T2: T(x, y) = T(y, 2) is obvious. 

T3: We have 


T(T(a,y), 2) = #9 (tw) + t(y)) + (2) 


= (min(t(e) + t(y),t(0)) + t(2)) 


= min(min(t(x) + t(y), £(0)) + t(z), ¢(0)). 
If t(x) + t(y) > t(0) then 


T(T(a,y), z) = min(t(0) + t(z),t(0)) = t(0) 


= min(#(2) + t(y) + e(2),t(0)) = T(e,T,2)). 
If t(z) + t(y) < ¢(0) then 
T(T (x,y), 2) = min(t(x) + t(y) + t(z), t(0)) = T(a, Ty, 2)). 


T4: To prove that T is increasing we consider x < u and y < v. Then 
t(x) > t(u) and t(y) > t(v) and t(x) + t(y) > t(u) + t(v). Since t(-) is 
decreasing we obtain 


T(x,y) =tY(t(@) + t(y)) < tH) + t(v)) = T(u, v). 


T- continuous: Since ¢ is continuous and since t~! is continuous we get 
t(—Y continuous when x 4 f(0). Also, 


lim ¢Y(r) = lim t71(x) =t71(t(0)) =0. 
ae (t) = Bian (x) (t(0)) 
T- Archimedean: 
T(a,2) = t{—) (2t(a)) < t(—) (t(x)) = min{z,t(0)} <a, 


ie., T(x, x) < x, Va € (0,1). 
(i)= (ii) Now let T be a continuous Archimedean t-norm. As before let 
ao) =TF(t0.,0) = T(x, 2+ ), ae) = 1. Then we define 


n—times 


gy =sup{y € [0, lly; < x} 


and 


(2) _ (ayy 
a Sas i. 
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) 


Since T is Archimedean we have limn_+o, ale = 1 and an) is well defined 


. (4) om) 
since Pp" = a@7"""~-. 


Let a be an arbitrary positive number. Let h : QM [0,00] — [0,1], h(r) = 
a‘), Since T is continuous then h is continuous. Also, it is easy to check that 


(B42) (ey () 
ae = Ta aes 
so we have 


h(r +s) = alt? = T(a’?, al) < af) = n(r), 


so h is non-increasing. Moreover, h is strictly decreasing 


n(2 42) =n (iene) < p(t) 
n qd nq nq 
(mqt1) (mq) 
(4) (4) i 
=> («! ) < («! ) = h (=) . 


va T 


Since h is monotone and continuous we can uniquely extend it to a real 
function h : [0,00] > [0, 1] 


h(x) = inf{h(r): r € QN[0, a]}. 
Since T is continuous h(x + y) = T(h(x), h(y)). We define 
t(x) = sup{y € [0, oo]|A(y) > x} U {0}. 


We observe that t is the pseudo-inverse of h. 
Then we obtain 


T(x, y) = T(A(t(a), h(t(y)) = h(t(a) + t(y)) 


= t-(t(x) + t(y)), 


i.e., we have obtained the existence of the additive generator t. 
To prove the uniqueness of t let us suppose that there are two additive 
generators t,,t2. Then we have 


tS) (ta (a) + try) = tf? (to(e) + ta(y)). 
Let u = to(x), v = to(y). Then 
HY (to AY (u) +t, 0t Yo) = tO Put 0). 


If u,v € [0,t2(0)] and w+ v € (0, te(0)] then 


24 2 Fuzzy Set-Theoretic Operations 


trotS Y(u)+toth Mv) =th otf Muto), 


Le., ty 0 tv) satisfies Cauchy’s functional equation F'(u+v) = F(u) + F(v) 
which has its solution F(x) = bx with b being a constant in (0,00). Then 
t1 0 tS? (2) = ba,x € [0,t2(0)]. Recall that « = te(y) and we get ti(y) = 
bte(y), Vy € [0,1], so t is unique up to a multiplicative constant and the proof 
is complete. | 


Theorem 2.32. (Representation of Archimedean t-conorms, e.g., Klement- 
Mesiar-Pap [87]) For a continuous function S' : [0,1]? — [0,1] the following 
affirmations are equivalent: 

(i) S is a continuous Archimedean t-conorm 

(ii) S has a continuous additive generator, i.e., there is a continuous 
strictly increasing s : [0,1] > [0, co], s(0) = 0, which is uniquely determined 
up to a multiplicative constant such that for all x,y € [0,1] we have 


S(x,y) = s—Y (s(x) + s(y)). 


We can write T and S as 


T(x, y) = t~*(min{t(x) + t(y), £()}) 


S(a,y) = s~*(max{s(x) + s(y), s(0)}) 


Example 2.33. By considering t(x) = —Inx as additive generator we obtain 
the t-norm T(x, y) =x-y (product t-norm). 

By taking t(x) = 1— «a we obtain the Lukasiewicz t-norm T(2,y) = 
max{x + y— 1,0}. 

For Frank’s t-norm 


«Try = log, (1 + 


the additive generator is 


2.4 Fuzzy Implications 


Fuzzy implications were studied by several authors and their usefulness in 
fuzzy inference systems makes them very important. 
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Definition 2.34. (Fodor [58)) Let I : [0,1] x [0,1] > [0,1] be a function. If 
the following conditions are fulfilled 
M1: Ifu<y, then I(a,z) > I(y,z), t.e., I is decreasing in its first variable; 
I2: Ify < z, then I(a,y) < I(a,z), te, I is increasing in its second 
variable; 
13: (1,0) = 0, (0,0) = 1(1,1) =1 
then I is called a fuzzy implication. 
Example 2.35. The operations I;(x,y) = max{1— 2x, y} 
In(x,y) = min{l—«2+y,1} and 
1 3 < 


A fuzzy implication is often denoted by x > y. 


are fuzzy implications. 


Proposition 2.36. If I is a fuzzy implication and if N is a negation then 
I'(x,y) =I(N(y), N(x)) ts a fuzzy implication too. 


Proof. The proof is left as an exercise. | 


Proposition 2.37. If I is a fuzzy implication then 
(i) (0,2) = 1,e € [0, 1); 
(ii) I(x, 1) =1Va € [0,1]. 


Proof. (i): 
1 = 1(0,0) < (0,2) < 1(0,1). 
Then it follows that [(0,2) = 1 for any a € [0,1], and also (0,1) = 1. 
(ii): 
1=1(0,1) > I(a,1) > 7(1,1) =1. 
Then I(z,1) = 1,Vz € [0,1]. = 


Definition 2.38. Let S be a t-conorm and N be a strong negation. Then 


T(x, y) = S(N(2),y) 
is called an S- implication. 
Proposition 2.39. I(x,y) = S(N(«),y) is an implication. 


Proof. Let us suppose that « < z. Then N(x) > N(z) and then S(N(a),y) 
> S(N(z),y), so I is decreasing in the first argument. The fact that I is 
increasing in the second argument is obvious. We observe that 


I(1,0) = S(N(1),0) = $(0,0) =0, 
1(0,0) = $(1,0) =1 and I(1,1) = S(0,1) =1. 7 


Example 2.40. (Kleene-Dienes) Let S = max, N(x) = 1— «x. Then the 
associated S-implication is I(a,y) = max{1— 2, y}. 
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Example 2.41. (Reichenbach) Let S be the probabilistic sum, t.e. S(x,y) = 
x+y—xy, and N(x) =1—2. Then I(x,y) =1—2+ xy is the S-implication 
associated to S. 


Example 2.42. (Lukasiewicz) Let S(x,y) = min{x+y,1} and consider the 
standard negation. Then we obtain the S-implication I(x,y) = min{l — a+ 


y; Ly. 


Remark 2.43. If I(x,y) is an S-implication then I(N(y), N(a)) is also an 
S-implication. 


Definition 2.44. Let T be a t-norm. 
Ir(x,y) = sup{2|T(2, z) < y} 
is called a residual implication (an R-implication). 


Proposition 2.45. An residual implication Ip is an implication. 


Proof. Let x; < xg. Then T (21, z) < T(x, z), Vz € [0,1]. If zo € {z|T (22, z) 
< y} then 2 € {z|T (21, z) < y}, ie, 


{2|T (22,2) < y} ¢ {elT (a1, 2) < yh. 
Then 
Ip (x2,y) = sup{z|T (x2, z) < y} 
< sup{z|T(e1, 2) < y} = Ir(e1,y). 


The verification of the other properties of an implication is straight- 
forward. a 


Remark 2.46. We have Ir(x,x) = 1, Vx € [0,1]. Indeed, since Ip(x,x) = 
sup{z|T (a, z) < x} and since T(a,1) = a we have Ip(a,x) = 1. 


Example 2.47. T = min gives the Godel implication 


1 if acy 
y ff z>y 


Ip(z, y) = { 
T = product gives the Goguen implication 


if esy 
if x«>y 


Ip(z,y) = { 


Bhke ke 


T = Lukasiewicz t-norm, gives the R-implication Ip(a,y) = min{l—2+y, 1}. 
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2.5 Fuzzy Equivalence 


Definition 2.48. (Fodor-Yager [61J) A function E : [0,1]? — [0,1] is a 
fuzzy equivalence if it satisfies the conditions: 

El: E(x,y) = Ely,2). 

£2: E(0,1) = E(1,0) =0. 

E3: E(x,x) =1,Va € [0,1]. 

Ef: Ifa<a'<y' <y then E(az,y) < E(a’,y’). 


A fuzzy equivalence is often denoted by 7 © y. 


Theorem 2.49. (Fodor- Yager [61)) The following statements are equivalent: 
(a) E is a fuzzy equivalence. 
(b) There exists a fuzzy implication I with the property I(a,x) = 1,Va € 
(0, 1] such that 


E(a,y) = min{I(«,y),T(y,@)}. 
(c) There exists a fuzzy implication I with the property I(x,x) = 1,Vxu € 
(0, 1] such that 
E(x, y) = I(max{ax, y}, min{x, y}). 
Proof. (b)=(a). Let E(z,y) = min{I(x,y),I(y,x)}. Then we can easily 


check the properties E1-E3. Regarding E4 we observe that ifa <a’ <y'<y 
then we have 


T(y,#) < I(a, x) < I(a,y) 


and so E(x,y) = I(y,z). Similarly E(2’,y’) = I(y’,2’). Also, I(y’,x’) > 
I(y',«) 2 I(y,«). Then E(2,y) < E(a’,y’). 
(a)=>(b). We consider 


_ 1 if a<y 
eu) = { E(z,y) if «>y 


Then I is a fuzzy implication. We show that J is decreasing in the first 
argument. Let « < z. If a < y then I(a,y) = 1 > I(z,y). If x > y then 
y <a <z and then 


I (x,y) _ E(z,y) 2 E(z,y) = I(z,y). 


Now we prove that J is increasing in the second argument. Let y < z. Ifa > z 
then 


I(x2,y) = E(a,y) < E(a,z) = I(a, z). 


If « < z then I(x, z) = 1 so I(a,y) < I(x,z). The boundary conditions for 
the fuzzy implications can easily be verified. 
Now we prove that 


E(a, y) a min{I (x,y), 1(y, x)}. 
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Indeed, since 


Ty, a) = { E(y,2) 7 E(a,y) eae 
we observe that 
od= {708 a 22) 
Also, we observe that if x > y then 


min{I(x,y),I(y,x)} = I(2,y). 


Indeed, if x > y then 


I(z,y) <I(y,y) < Ily, 2). 


The case x < y can be discussed in a similar way. If x = y then I(x,y) = 
I(y,v) =1. 

The equivalence (b) <= (c) is obvious based on the fact that if « > y 
then max{z, y} = x and min{z, y} = y. Also, in this case 


I(z,y) < I(y,y) < Ity, 2) 


and 
E(x,y) = I(a,y) = I(max{z, y}, min{z, y}). 


When «x < y a similar reasoning applies. If = y then 


E(x,y) = I(a,y) = I(max{z, y}, min{z, y}) = 1. 


Example 2.50. The fuzzy equivalence x & y= min{l—xv+y,l—y+ 2} is 
derived from the Lukasiewicz t-norm. 


2.6 Problems 


1. Verify that the A-complement N(x) = =. » > —1, is a strong nega- 


tion. Find a function ¢ : [0,1] > [0,1]. Such that Ny (x) = y~!(1—-y(a)). 


2. Prove that the product and the probabilistic sum: 


roy =x-y 
uScy =xt+y— xy. 


is a t-norm and a t-conorm respectively. Decide whether they form a 
DeMorgan triplet with the standard negation. 
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. Prove that the Lukasiewicz operations 


zTry = (a+y—1)V0 
eSry =(axt+y)A1. 


are a t-norm and a t-conorm respectively. Decide whether they form a 
DeMorgan triplet together with the standard negation. 


. Show that the nilpotent minimum and nilpotent maximum are t-norm 
and t-conorm respectively 


_ jf eAyifety>1 
eto = { 0 otherwise 


_ J «Vyife+ty<1 
Soy = { 1 otherwise : 


Decide whether they form a De Morgan triplet with the standard nega- 
tion. 


; Conside: the fuzzy sets A,B: {1,2,.. anU — [0,1] defined a A(z) = 

402,07 14 07 + 024040 +$4+H, Biz) = 9494944 
bs 708 414 05 p02 4 i. Calculate AT, B, AS,B, AToB, ASGB, 
where Ty, g and Sz,q stand for the Lukasiewicz and Goguen t-norms and 
t-conorms. 


. Consider oo fuzzy sets A,B : Ry — [0,1] defined as A(x) = p25, 
B(x) = i: Calculate AT, B, AS, B, ATgB, ASGB, where Tyg and 
Sz,q stand for the Lukasiewicz and Goguen t-norms and t-conorms, and 
graph them. 


. Let us consider the fuzzy sets 


0 if, u<2 
a i DGG 
2 if 6<a<10 ’ 
O° a> esa 


A(x) = 


0 iff «<3 
2-3 if 3<a<4 
B(x) = 1 if 4<a<5 
Ge if 5<a<7 
0 if T<¢2 


Calculate AT, B, AS, B, ATgB, ASGB, where Tyg and Sz,q stand for 
the Lukasiewicz and Goguen t-norms and t-conorms, and graph them. 


30 


10. 


11. 
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. Prove that Frank’s t-norm and t-conorm 


®_1)(s¥—1 
s—1 
«Spy =1—(1—2)Tp(1— y), 
where s € (0,00) \ {1} verify the relation 


“Try +aSpy =x+y. 


. Prove that the drastic product and sum are the least t-norm and the 


greatest t-conorm respectively. 


Prove that any t-norm T and any t-conorm S is distributive with respect 
to V and A ie., 


(a V y)Tz = (22) V (yT2) 
(a A y)Tz = (272) A (yz) 
(a V y)Sz = (#82) V (yS2z) 
(a A y)Sz = (#82) A (ySz) 


for any x,y,z € [0,1]. 


Let us consider the fuzzy sets 


Consider the fuzzy implications 
Ii(a,y) = max{1 :* ay 


and 
1 if w<y 
y if x>y 


h(ew)={ 


Calculate and graph (A, B) and I2(A, B). 


12. 


13. 
14. 
15. 
16. 
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Consider the fuzzy equivalences 
Ey = min{ I (2, Y)s qh (y, x)} 


and 
Ey = min{ J2(x, y)s In(y, x)} 


generated by the implications in the previous problem. Calculate and 
graph F(A, B) and £2(A, B) based on the fuzzy sets considered in Prob- 
lem 


Prove that the implications in Example are fuzzy implications. 
Prove Proposition [2.36 
Prove that the function in Example 2.50] is a fuzzy equivalence. 


Find the fuzzy R-implication, S-implication and the associated fuzzy 
equivalences that we can obtain starting from Goguen and Fodor-Perny 
t-norm and t-conorm respectively. 


3 
Fuzzy Relations 


3.1 Fuzzy Relations 


Definition 3.1. (Classical relation). A subset RC X x Y where X and Y 
are classical sets, is a classical relation. 


A classical relation can be characterized by a function R: X x Y > {0,1}, 


_f1 if @wWeR 
R(z,y) = { 0 otherwise 


Definition 3.2. (Fuzzy Relation, Sanchez [129], Di Nola-Sessa-Pedrycz- 
Sanchez [48/, De Baets [42]) Let X,Y be two classical sets. A mapping 
R:X xY — [0,1] is called a fuzzy relation. The number R(x,y) € [0,1] 
can be interpreted as the degree of relationship between x and y. 


Remark 3.3. A fuzzy relation can be seen as a fuzzy subset of the set X x Y. 
We denote by F(X x Y) the family of all fuzzy relations between elements of 
X and Y. 


Example 3.4. R=”much greater than” 


—jr- x> 
R(x, y) = al a . 


otherwise 


B. Bede: Mathematics of Fuzzy Sets and Fuzzy Logic, STUDFUZZ 295, pp. 33-19] 
DOI: 10.1007/978-3-642-35221-8 3 © Springer-Verlag Berlin Heidelberg 2013 
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A fuzzy relation between elements in two finite sets X = {x1,22,...,%m} and 
Y = {y1, ya,---; Yn} can be represented as a matrix 


R(x1, y1) R(x1, y2) ae8 R(x1, Yn) 
R R(x2, y1) R(x2, y2) soi R(x2, Yn) 
R(a@m,Y1) R(&m, Y2) te R(&m; Yn) 


Since fuzzy relations are themselves fuzzy sets, it is possible to perform fuzzy 
set operations on them 


N(R(x,y)) = R(a,y) = 1— R(x, y), 
(RV S)(#,y) = Rw, y) V S(x,y), 


(RA S)(a,y) = R(x, y) A S(a,y). 
The inverse in a set-theoretic approach for a fuzzy relation would be 
R-"(a,y) = Rly, 2), 
i.e. the transpose. We can also consider t-norm and t-conorm operations 
T(R, P)(x,y) = T(R(@, y), Pla, y)), 


S(R, P)(z,y) = S(R(z,y), P(x, y)), 


where T,S are a t-norm and a t-conorm respectively. 


3.2. Max-Min Composition 


Definition 3.5. Let RE F(X x Y) and S € F(Y x Z) be fuzzy relations. 
Then RoS € F(X x Z), defined as 


Ro S(a,z) = VV R(x, y) A Sy, 2), 
yEeY 


is called the max-min composition of the fuzzy relations R and S. 


Remark 3.6. The maz-min composition is well defined being the supremum 
of a nonempty bounded subset of real numbers. 


If R € F(X x X) then we can define R? = RoR, and generally R" = RoR"1, 
n> 2. 
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Let X = {21,...,2n},Y ={y1,..., Ym}, and Z = {21, ..., Zp} be finite sets. If 
R= (rij i= seks n,j=l,...m © F(X xY),and $= (85%) j=1 ited m,k=1,...,p © F(Yx 


Z) are discrete fuzzy relations then the composition T = 
(tik i= sels n,k=1,....p = RoSeE F(X x Z) is given by 


m 


tik = VV Tig A Sjks 
j=l 


0.8 0.3 
Example 3.7. [f R = ca - io) and S = [n 0 then 


Proposition 3.8. (i) The max-min composition is associative, i.e., 
(Ro S)oQ = Ro(SoQ), 


where RE F(X x Y), SE F(Y x Z) and QE F(Z xU). 
(ii) Let Ri, Ro € F(X XY) and QE F(Y x Z). If Ri < Re then 


RioQ< R20Q. 
Proof. The proof of (i) is left to the reader. 
(ii) 
Ro Q(a,z)= \V Ri(x,y) A Q(y, 2) 


yeY 


< VV Ra(z,y) A Q(y, 2) = R20 Q(2,z). 


yeY 


Proposition 3.9. For any R,S © F(X x Y) andQ € F(Y x Z) we have 
(i) (RV S)oQ = (RoQ)V (SQ) 
(ti) (RAS)oQ < (Ro Q)A(SoQ). 


Proof. (i) We prove the equality by double inclusion. 


(RV S)oQ(a,z) = \VJ (RV S)(a,y) A Q(y,z) 


yeY 


= V (Ra, y) A QYy, 2)) V (S(@, y) A Q(y, 2)) 


< V (R@, yA QW,2)) Vv V (Sy) A QU, 2)), 


yeY yeY 
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1.€., 
(RV S)\oQ<(RoQ)V(S0Q). 


On the other hand, from the previous proposition we have RoQ < (RVS')oQ 
and SoQ@< (RV S)oQ, and then 


(RoQ)V (SQ) < (RV S)0Q. 


Combining the two inequalities, the required conclusion follows. 
(ii) We have 


(RAS) 0 Q(a,z) = \ (RA S)(a,y) A Q(y,2) 


yeY 


= V (Ry) A QU, 2) A (S(2,y) A Q(y,2)) 


yeY 


< V (Ray) AQ, 2))A VV (S(@,y) A QW, 2)) 


yey yeY 


= (Ro Q) A (So Q)(a, 2). 


| 
Remark 3.10. Equality in (ii) does not hold. Indeed, if we consider 


PE PR e (Tyemeseen (FH) 
while (ReQ)A(80Q)=( 4 


3.3. Min-Max Composition 


Definition 3.11. (e.g. Nobuhara-Bede-Hirota [118)) Let R€ F(X x Y) and 
SeF(Y x Z). Then ReS€ F(X x Z), defined as 


ReS(xz,z)= \ R(x, y) V S(y, z) 
yeY 


is called the min-max composition of the fuzzy relations R and S. 


0.8 0.3 
Example 3.12. [f R = ( Ge er Te ) and S = 0.1 O then 


! oe 0.5 0.6 
0.5 0.3 
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Proposition 3.13. (i) The min-max composition is associative, i.e., for any 
REF(X xY),SE€F(Y x Z) andT € F(Z xU) we have 


(ReSjeT=Re(SeT). 
(ti) Consider Ri, Ro € F(X x Y), QE F(Y x Z). If Ri < Ro then 
RieeQ< RoeQ. 
Proof. The proof is left to the reader as an exercise. a 
Proposition 3.14. For any R,S © F(X x Y) andT € F(Y x Z) we have 


(i) (RA S)eT =(ReT)A(SeT). 
(ii) (RV S)eT > (ReT)V(SeT). 


Proof. The proof of the proposition is similar to the corresponding result in 
the max-min composition case and is left as an exercise. | 


Remark 3.15. Equality in (ii) does not hold. Indeed, R = ( Boe ) S= 


G )t=( 4 g ) then (Rv S)eT = ( 5 { ) while (ReT)v (Se 


0 0 
ne(°°) 
Proposition 3.16. If we consider the standard negation we have Ro S = 
ReSandReS=ROS. 
Proof. We observe that 


ReSee)= VV R(a,y) A Sy, z) = \ R(a,y) A S(y, z) 
yeY yeY 


= \\ R@,y)V Sy,z) = Re 5(z,2). 
yeY 


The equality Re S = Ro S. can be obtained in a similar way. a 


Remark 3.17. The min-max composition can be naturally generalized to 
min-t-conorm compositions 


Res P(z,z)= f\ R(a,y)SPly,2), 
yeY 


where S' is an arbitrary t-conorm. 


38 3 Fuzzy Relations 


3.4 Min — Composition 


Let — be the standard Gédel implication defined as 


1 if r<y 


zy =sup{z€ [0, IljaAz<y}= { ; diiercine 


Proposition 3.18. For any x,y,z € [0,1] we have 

(i) (a@Vy) > 2z=(@> z)A(y> 2). 

(ii) (a@ Ny) 92 =(@ > z)V (y> 2). 

(itt) © > (yV z) =(a@ > y)V (a> 2). 

(iv) & > (yANz) =(@ > y)A (a> 2). 

(ujaA(a>y)<y. 

(vi) a> (aAy)>y. 

(vii) (w@ > y) ay >a. 
Proof. (i) Case 1. If Vy < z then (2 V y) > z = 1 and also we have x < z 
and y < z. Then (x& > z)A (yz) =1A1=1. 

Case 2. Ifa Vy > z then (2 Vy) > z =z and x > z or ,y > z so we have 
(a > z) =z or (y > z) = z and then (4& > z) A (y > z) =z. 

(ii) Case 1. If aA y < z then (x Ay) > z = 1. Also, we have either 
x < zor y < z in which case either x — z = 1 or y ~ z = 1 and so 
(t>z)V(yozj=1. 

Case 2. If aA y > z, then (a Ay) > z = z. Also, if (x A y) > z then both 
x>zandy>zandx>z=zandy>z=z. 

(iii) Case 1. If a < (yV z) then « > (yV z) = 1. Also we have either x < y 
orr<zandsox>y=lorrx>oz=l1. 

Case 2. Otherwise « + (yV z) = yV z and we have x > y and w > z and 
e>ay=yande>z=2. Then (t@ > y)V(a>z)=yVz. 

(iv) The proof is left as an exercise to the reader. 

(v) Case lL. Ifa<ythenzA(@>y)=2r2Al=aK<y. 

Case 2. Otherwise x A (a > y)=x2Ay=y. 

(vi) Case 1. Ifa<ythena > (aAy)=ax>ua=12>y. 

Case 2. Otherwise when x > y then we have « > (cA y) =x y=y. 

(vii) The proof is left as an exercise to the reader. a 


Definition 3.19. The min— composition can be defined as: 
R<S(a,z) = \ R(x,y) > S(y, 2). 
yeY 


Often in the literature (see e.g. De Baets [42]) it is called subcomposition and 
a dual operation is considered as 
Ro S(a, z) = | S(y,z) )—> R(z,y) 
yeY 


called the supercomposition. The relation between the two is given by the 
next proposition. 
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Proposition 3.20. For Ri ¢ F(X x Y) and Rz € F(Y x Z) we have 

(i) Ri 4Rq = (Ry* > Ry*)7}; 

(i) Ri > Ro = (Rz'<R,')-}. 
Proof. The proof is left to the reader as an exercise. | 
In the present work we will mainly use the subcomposition and we call it 
simply min— composition. 
Proposition 3.21. If R,S © F(X x Y) and Q € F(Y x Z) are such that 
R<S thenRIQ> SQ. 


Proof. Since — is decreasing in the first argument we have 


R«Q(z, 2) = i R(z,y) Tt Q(y; 2) 


yeY 


> \ S(x,y) > Q(y,z) = R«S(a,z). 


yeY 
| 


Proposition 3.22. For any R,S © F(X x Y) andQ € F(Y x Z) we have 
(i) (RV S)1Q = (RIQ)A(S SQ). 
(ii) (RAS) 1Q 2 (RQ) V (S<Q). 


Proof. (i) From the previous proposition we have (RV S) <Q < R<Q and 
(RV S)«Q < $<Q and then 


(RV S)1Q < (RQ) A(S <Q). 


Also, from Proposition B.18] (i) 


(RV S) <Q(2,z) = (\ (R@,y) Vv S(a,y)) > Q(y,2) 


yeY 


= \(R@,y) > Qy,2)) A (S(@,y) + Q@,2)) 


yeY 


> A (Ray) > Qy,2)) A J (S(@,9) > Oy, 2)) 
yeY yeY 
= (R«IQ)A(S<Q)(a, z). 


(ii) Similar to (i) we have (RA S)1Q > R<dQ and (RA S)1Q>S5<Q 
and then 
(RAS)IQ 2 (R«Q) V (S4Q). 
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3.5 Fuzzy Relational Equations with Max-Min and 
Min — Compositions 


We consider the following two fuzzy relational equations 
RoP=Q 
and 
RsiP=Q 
with RE F(X x Y), PE F(Y x Z) and QE F(X x Z). 
Theorem 3.23. The following inequalities hold true: 
(i) P< R14(RoP); 
(ii) Ro (RQ) <Q; 
(u) R<(Pa(Re Py) 
(iv) (PAQ>!) oP <Q. 


Proof. (i) Using Proposition 3.18] (vi) we have for every y € Y and z € Z, 


R-1 (Ro P)y,z) = (\ R(y,2) > (Ro P)(z,z) 
LEX 


= \ R(y,2) > VV R(a,t) A P(t, z) 


vEX teY 
> | Ray) > Rey) AP(y,z) > (\ Ply.2) = Ply,2)- 
cEX cEX 
(ii) From Proposition B.18] (v) we obtain for every x € X and z € Z 
Ro (R71 4Q)(z, z) = \V Ria,y)A R-! 2Q)(y, z) 


yeY 


= \V Ria,y)A a t) > Q(t, z)) 


yeY tex 


< VV R(a,y) A(R (x,y) + Q(a, z)) a \) O@y2)= 2). 


yey yeY 


(iii) We have for every x € X andy € Y 


(P «(Ro P)"')""(a,y) = P4(Ro P)*(y,2) 


= f\ Ply,z) 3 (Ro P)(z,2) 


ZEZ 
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= \ Py,2) > VV Rla,t) A P(,z) 


zZEZ teY 


> \ Py.2) > Ray) AP(y.2) = (A Ray) = R(a,y). 
ZEZ zEZ 


(iv) The proof of (iv) is similar to that of (iii), and it uses Proposition 
3.18 a 


Theorem 3.24. (Sanchez [129]) (i) Consider the equation Ro P= Q with 
unknown P. The equation has solutions if and only if R~'«Q is a solution 
and in this case it is the greatest solution of this equation. 

(ii) Consider the equation Ro P= Q with unknown R. The equation has 
solutions if and only if (P< Q~1)~} is a solution and in this case it is the 
greatest solution of this equation. 


Proof. (i) “=” If P = R7' <Q is a solution of the equation Ro P = Q then 
the equation possesses solutions. 

“=>” Let us suppose now that the equation Ro P = Q has a solution 
denoted by P. Then by Theorem B.23] (i) we have 


Pe Ra hel) =F 40, 


ic., R-' <Q is greater than or equal to any solution P of the equation 
RoP=Q. 

To show that R~! <Q is a solution we use double inclusion. By Theorem 
[3.23] (ii) we know 

Roth 'aQ)< ©. 
On the other hand since P < R~! <Q and since o is increasing in its second 
argument, we have 
Ro(R'4Q)>RoP=Q. 


Combining the two inequalities we get Ro(R7-!<Q)=Q,ie., R'sQisa 
solution and moreover, it is the greatest solution. 
(ii) The proof of (ii) is similar. rT 


Example 3.25. Let us consider the fuzzy relational equation 


0.3 0.2 0.4 0.3 0.4 0.4 
0.1 03 05 JoP={ 03 0.5 0.5 
0.5 0.4 0.6 0.3 0.5 0.6 


Then 
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and since 
0.3 0.2 0.4 03 #1 1 0.3 0.4 0.4 
0.1 03 05 Jo} 03 1 #1 = 0.3 0.5 0.5 ], 
0.5 0.4 0.6 0.3 0.5 1 0.3 0.5 0.6 


then R-! <Q is a solution of the equation. From the previous theorem it 
follows that it is the greatest solution of the given equation. 


Theorem 3.26. The following inequalities hold true: 

(i) (QP) aP 2 Q; 

(i) (RaP\aP-* > R; 

(iti) R-+ 0 (R«P) < P; 

(iv) R«a(R-10Q)>Q. 
Proof. (i) Using Proposition B.18] (vii), and taking into account that —> is 
decreasing in its first argument we have 


(Q4P7')aP(z,z)= [\ (Q<P™)(@,y) > Ply,z) 


yeY 


= AG Q(x, t) + Ply,t)) > PYy,2) 


yeY tEZ 


> A Qe.2) > PY.) > PWD= \ AUn2) =Az,2). 
yeY yeY 
(ii), (iii), (iv) The proofs of these properties are similar and they are using 
the results in Proposition [3.18 Z 


Theorem 3.27. (Miyakoshi-Shimbo [112J) (i) Consider the equation RAP = 
Q with unknown R. The equation has solutions if and only if Q<«P7' is a 
solution and in this case it is the greatest solution of this equation. 

(ii) Consider the equation R« P = Q with unknown P. The equation has 
solutions if and only if R~! 0 Q is a solution and in this case it is the least 
solution of this equation. 


Proof. (i) “<=” Obvious. 
“=>” Let us suppose now that the equation R<« P = Q has solution R. 
Then by Theorem B.26] (ii) we have 


R<(haP\aP*=Q4P™. 


ic, Q<«P~' is greater then any solution R. 
By Theorem 3.26] (i) we know that 


Q<(Q<P')4P. 
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On the other hand since R < Q <P! and since < is decreasing in its first 
argument, we have 
Q=hAPS (GaP) ar 


Combining the two inequalities we get Q = (Q< P~!) <P. 
(ii) “” Obvious. 
“=>” Let P be a solution of R<« P = Q. Then by Theorem [3.26] (iii), 
P>R-0(RaP)=R'0Q, 


i.c., R710 Q is less then any solution P. 
Also, by Theorem B.26] (iv) 


Q< Rath 39) 


since P > R~! <Q and taking into account that < is increasing in its second 
argument we have 
Q=R«4P>R«(R'0Q) 


and we get Q= R«(R-10Q). 7 


Example 3.28. Let us consider the fuzzy relational equation 


0.3 0.2 0.4 0.3 0.4 0.4 
0.1 03 05 |aP= 1 06 0.5 
0.5 0.4 0.6 0.5 0.5 0.6 
Then 
0.5 0.5 0.5 
R10Q= 0.4 0.4 0.4 
0.5 0.5 0.6 
Since 
0.3 0.2 0.4 0.5 0.5 0.5 1 1 1 
0.1 0.3 0.5 Ja] 04 04 0.4 = 1 1 1 
0.5 0.4 0.6 0.5 0.5 0.6 0.5 0.5 1 


is not a solution of the equation, by the preceding theorem it follows that the 
equation has no solutions. 


3.6 Max-t-Norm Composition 


Definition 3.29. The maz-min composition can be naturally generalized to 
max-t-norm compositions 


Ror P(z,z)= \/ R(z,y) T Ply,2), 
yeY 


where T is an arbitrary t-norm. 
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Proposition 3.30. (i) The maz-t-norm composition is associative, i.e., 
(Ror S)or Q = Ror (Sor Q), 


for anyREF(X xY), SEF(Y x Z) andQE F(Z x U). 
RiorQ < R2orQ 
for any Ri, Ro € F(X x Y) and QE F(Y x Z). 


Proof. Since the t-norm T is increasing we have 


(Ror S) or Q(a,u) = VV | VV R(w,y) T S(y,z) | T Q(z,u) 


zEZ \yEeY 


=V V Ray) T S(y,z) T Q(z,u) = Ror (Sor Q)(a,u). 


zEZyeY 
(ii) The proof of (ii) is based on the fact that T is increasing in both of its 


variables. | 


Proposition 3.31. For any R,S ¢ F(X x Y), Q © F(Y x Z) and any 
t-norm T we have 

(i) (RV S) or Q = (Ror Q)V (S or Q) 

(ti) (RAS) or Q < (Ror Q) A (Sor Q). 


Proof. (i) Since T is distributive with respect to V we have 


(RV S) or Q(z, z) = \/ (RV S)(,y) T Q(y,2) 


yeY 


< V (Ry) T Qy,2) Vv V (S(@,y) T QU, 2), 


yeY yeY 


Also, Ror Q < (RV S) or Q and Sor Q < (RV S) of Q, and then 
(Ror Q)V (Sor Q) = (RV S) or Q. 


(ii) Is left to the reader as an exercise. a 


3.7 Min >; Composition 


Let T be an arbitrary continuous t-norm and +7 be the R-implication defined 
as 
“xr y =sup{z|x T z < y}. 
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Proposition 3.32. For any x,y,z € [0,1] and for any t-norm T the residual 
implication +7 has the following properties: 

(i) eT(a@ ry) <y. 

(ii) x > (aTy) > y. 

(iit) (wc ar y)rry>z. 


Proof. (i) We have 
«T (a >r y) = 2T sup{z|xzTz < y}. 


Let now € > 0 arbitrary. Then there exist a z) € {z|aTz < y} such that 
rrp y <2 +e. Then 


«xT (a > y) < eT (z +8). 
Since T is continuous this implies 
“T(x Sr y) < «Tz. 


Now, the condition zo € {z|aTz < y} implies Tz) < y, and then we get 
aT (ary) <y. 
(ii) It is easy to observe that y € {z|aTz < xT y} and so, 


xr (xTy) = sup{z|xTz < xTy} > y. 
(iii) To prove the last inequality we observe that 
(« >7 y) Sr y =sup{z|(e or y)Tz < y}. 


Using now (i) we have (a > y)Tax < y and then x € {2|(4@ Sr y)Tz < y}. 
Then (1@ Sry) >ry>e. | 


Definition 3.33. The min-7 composition can be defined in a similar 
way as the min — composition: 


Rar S(a, z) = as R(x, y) aerct b S(y, Z) 
yeY 


Proposition 3.34. If R,S © F(X x Y) are such that R < S and if Q € 
F(Y x Z) then Rar Q> SQ. 


Proof. The proof is left to the reader. a 


3.8 Fuzzy Relational Equations with Max-t-Norm and 
Min —7; Compositions 


Fuzzy relational equations with max-t-norm or min +7 compositions can be 
studied in a similar way as the equations above. 
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We consider the following two fuzzy relational equations with max-t-norm 
and min +7 compositions 


Ror P=Q 


and 
Rip P=Q 


with RE F(X x Y), PE F(Y x Z) and QE F(X x Z). 
Theorem |3.23]can be generalized as follows. 


Theorem 3.35. The following inequalities hold true: 
(i) P< Ro 4p (Ror P); 
(it) Ror (R71 <7 Q) < Q; 
(iti) R< (P <r (Ror P)!)! 
(iv) (P «7 Q-1)-tor P< Q. 


Proof. First let us observe that since +7 is a fuzzy implication, it is de- 
creasing in the first argument and increasing in the second argument. 
(i) Using Proposition B.32] (ii) we have for y € Y and z € Z, 


Ro ap (Ror P)(y,z) = A Ro'(y,2) or VV R(a,t)TP(t, 2) > 
cTEX teY 
> \ Ray) 7 (R(a, y)TP(y,2)) > [A Ply,2) = Ply, 2)- 
rEX rEX 


(ii) From Proposition B.18] (i) we obtain 


Ror (R7 ar Q)(a,z) = \V R(a,y)T( \ Ry, t) or Q(t,z)) < 
yey tex 


< VV R(x, y)T(R( (z, y) +r Q(z, 2)) 2\/ O@2)= 2) 


yeY yeY 


(iii), (iv) The proofs of (iii) and (iv) are similar to those of (i), (ii). a 


Theorem 3.36. (Sanchez [129], Miyakoshi-Shimbo [112)) (i) Consider the 
equation Rop P= Q with unknown P. The equation has solutions if and only 
if R-! <7 Q is a solution and in this case it is the greatest solution of this 
equation. 

(ii) Consider the equation Ror P = Q with unknown R. The equation has 
solutions if and only if (P<Q~1)~} is a solution and in this case it is the 
greatest solution of this equation. 


Proof. The proof of this theorem is similar to that of Theorem [3.24] a 
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Theorem 3.37. The following inequalities hold true: 

(i) (Q<r P“') <r P > Q; 

(it) (R «<r P) dr po} > R; 

(iti) R-+ op (Rp P) < P; 

(iv) Rep (R7' or Q) > Q. 
Proof. (i) Using Proposition .32] (iii), and taking into account that +7 is 
decreasing in its first argument we have 


(Q <r P7!) ap P(x,2z) = [\ (J Q(2,t) ar Ply,t)) 7 Ply, 2) = 
yEY tEZ 


2 \ (Q(2, z) el P(y, 2) >T P(y, 2) 2 \ Q(z, z) = Q(2, 2). 
yeY yeY 


(ii), (iii), (iv) The proofs of these properties are similar to the previous 


reasoning. | 


Theorem 3.38. (Miyakoshi-Shimbo [112)) (i) Consider the equation R <r 
P=Q with unknown R. The equation has solutions if and only if Q <p P71 
is a solution and in this case it is the greatest solution of this equation. 

(ii) Consider the equation Rap P = Q with unknown P. The equation has 
solutions if and only if R~! or Q is a solution and in this case it is the least 


solution of this equation. 


Proof. The proof follows the ideas in the proof of Miyakoshi-Shimbo 
Theorem [3.27] | 


3.9 Problems 


1. Consider the fuzzy relations 


0.1 04 0.2 0.5 
R= 0 O02 0.3 0.4 
0.4 05 0.2 O01 
1 03 03 O 
and 
0.3 03 0.2 0.1 
_ {| 06 05 0 0.2 
a 0.2 0.1 04 O.1 
0.4 0.1 0.2 0.5 


Calculate RoQ, ReQ, R«Q, ROQ. 


48 


3 Fuzzy Relations 


. Given 


0.1 04 0.2 0.4 
R=] 04 05 0.2 0.1 
0.8 0.3 0.6 0.2 


0.3 01 0.2 
Q=[ 05 01 05 
0.3 0.2 0.6 


decide whether the equation Ro P = @ does or does not have a solution. 
If the answer is yes, find the greatest solution. 


. Given 


0.1 0.4 0.2 0.4 
R= 0.4 0.5 0.2 O.1 
0.8 03 0.6 0.2 
and 
0.3 0.1 0.2 
Q={ 05 01 0.5 
0.3 0.2 0.6 


decide whether the equation R<«P = Q does or does not have a solution. 
If the answer is yes, find the least solution. 


. Prove Proposition B.18] (iv) and (vii) 
. Prove Proposition |3.20 

. Prove Theorem 3.23] (iv) 

. Prove Theorem [3.24] (ii) 

. Prove Theorem B.26] (ii), (iii), (iv). 

. Prove Proposition B.31) 

. Prove Proposition [3.34 


. Consider the fuzzy relational equation Re P = Q. Find a solvability con- 


dition and find a solution of this equation, supposing that it is solvable. 


. Let R € F(X x X) be a fuzzy relation. Let us consider the eigen fuzzy 


sets equation Ro A= A, with A € F(X). Prove that the equation has a 
least and a greatest solution and these can be calculated as 


A, = lim R” of. 
noo 
and 
Ag = lim Ro X. 
noo 


Hint: Use Tarski-Knaster and Kleene’s fixed point theorems (see 
appendix). 


13. 


14. 


15. 


16. 
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Let R € F(X x X) be a fuzzy relation. Let us consider the eigen fuzzy 
sets equation Re A = A, with A € F(X). Prove that the equation has a 
least and a greatest solution. 


Given R € F(X x X) we consider the convex combined composition 
defined as 

Rx A=X2X(Ro A)+(1-A)(Re A), 
with A € F(X). Prove that the equation has a least and a greatest 
solution. 


Generalize problems to the case of max-t-norm composition 
Rory A, min-t-conorm Reg A and convex combined composition 


Let R € F(X x X) be a fuzzy relation. Consider the eigen fuzzy sets 
equation with min > composition R<« A = A, A € F(X). Investigate 
existence and the structure of solutions of this equation. 


A 
Fuzzy Numbers 


4.1 Definition of Fuzzy Numbers 


Fuzzy numbers generalize classical real numbers and roughly speaking a fuzzy 
number is a fuzzy subset of the real line that has some additional properties. 
Fuzzy numbers are capable of modeling epistemic uncertainty and its prop- 
agation through calculations. The fuzzy number concept is basic for fuzzy 
analysis and fuzzy differential equations, and a very useful tool in several 
applications of fuzzy sets and fuzzy logic. 


Definition 4.1. (see e.g., Diamond-Kloeden [44)) Consider a fuzzy subset 
of the real line u: R > [0,1]. Then u is a fuzzy number if it satisfies the 
following properties: 

(i) u is normal, i.e. Srp € R with u(ao) = 1; 

(ii) u is fuzzy conver (i.e. u(ta + (1 —t)y) > min{u(x), u(y)}, Vt € [0, 1], 
x,y €R); 

(iit) u is upper semicontinuous on R (i.e. Ve > 0 3d > 0 such that u(x) — 
u(ao) <€, |x — ao| < 0). 

(iv) u is compactly supported i.e., cl{x € R; u(x) > 0} is compact, where 
cl(A) denotes the closure of the set A. 

Let us denote by Re the space of fuzzy numbers. 


Example 4.2. The fuzzy set u: R= [0,1], 


0 iff «<0 

x iff O<a<l 
(2-2)3 if 1<2<2 

0 iff «v>2 


u(x) = 


is a fuzzy number. See figure [4.1 


B. Bede: Mathematics of Fuzzy Sets and Fuzzy Logic, STUDFUZZ 295, pp. 51-64] 
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1.075 
0.97] 


0.87 


0.6 0.8 1.0 


Fig. 4.2 Example of a fuzzy number and its core 


Example 4.3. The fuzzy set 


a 


= 1 
(2.5 — x) 
0 


in Figure [4.2] is a fuzzy number as well. 


Example 4.4. The fuzzy set represented in Figure|4.3| is not a fuzzy number 


since it is not fuzzy convex. 


if 
if 
if 
if 
if 


x<O0 
O0<2<1 
1l<a<1.5 
15<a2<2.5 
a> 2.5 
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Fig. 4.4 A singleton fuzzy number 


Remark 4.5. Obviously any real number is also a fuzzy number, t.e., RC 
Rs. Here R C RF is understood as 


R= een x is usual real number} F 


X{a} 18 a singleton fuzzy number for any given real number x € R and it can 
be identified with x € R (see Figure[4.4) 


Also, fuzzy numbers generalize closed intervals. Indeed, if I denotes the set 
of all real intervals, then I C Ry, where 
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1.075 
os 
0.87 
077 
0.67 
0.57 
047 
0.37 
0.27 


0.174 


0.0 T T T T T T T 1 
0.0 0.1 0.2 0.3 0.4 0.5 0.6 07 0.8 0.9 1.0 


Fig. 4.5 Example of a closed interval interpreted as a fuzzy number 


I = {x{a,); [@, 6] is a usual real interval} 
(see Figure [4.5). 


Definition 4.6. For0<r<1, we denote 
ur = {x € R;u(z) > r} 


and 


ug = cl{a € R; u(x) > O}. 


Then ur, will be called the r—level set of the fuzzy number u. The 1-level 
set is called the core of the fuzzy number, while the O-level set is called the 
support of the fuzzy number. 


The following Theorem is known as the Stacking Theorem. 


Theorem 4.7. (Stacking Theorem, Negoita-Ralescu [115/) If u € Re is a 
fuzzy number and u, are its level-sets then: 

(i) ur is a closed interval u, = [u,,ut], for any r € [0,1]; 

(ii) [fO<1ry < ro <1, then u,, C ur. 

(iii) For any sequence rp, which converges from below to r € (0, 1] we have 


Co 
(-) thea = te 


n=1 


(iv) For any sequence r, which converges from above to 0 we have 


cl (U | = Uo. 
n=1 
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Proof. (i) Let us first remark that all the sets u, are nonempty and bounded 
since u; # & and because up is bounded (a compact set in R is closed and 
bounded). Let u be a fuzzy number and r € (0, 1]. If a,b € u,, then u(a) > r 
and u(b) > r. Then from the fuzzy convexity, if x € [a,b] we get 


u(x) > min{u(a), u(b)} = 7, 


ie.,  € [a,b]. As a conclusion u contains any closed interval [a,b] together 
with the points [a, 6] this means that u, is convex. All is left to be proven is 
that u, is closed. Upper semicontinuity implies that if u(ao) <r then there is 
an open interval W with xv) € W such that u(x) < r, Va € W. It immediately 
follows that the set {a|u(a) <r} is open and then it has a closed complement, 
i.e., up is closed. On the real line, closed convex sets are closed intervals so 
u, is a closed interval for any r € [0, 1]. 

(ii) It is easy to check that (ii) holds. Indeed, if 0 <r; < rg < 1 then if 
x € u,, then u(x) > rg > 71 and so, x € u,,. If ry = 0 or rg = 0 then the 
proof of (ii) is immediate. 

(iii) Let rn 7 r be non-decreasing. Then u,, C u,y,_,, is a descending 
sequence of closed intervals u,;,, = [u;,, uj]. Then it is easy to see that 


Tn? 
u;,, Uzi converge, in which case let uz, > a, ui, > b and 


[a, b] = q Ur, 
n=1 


We have to prove that u, = [a,b]. For a given x € [a,b] we have 
u(x) > min{u(a), u(b)}. 


So, it is enough to show that u(a) > r and u(b) > r. Suppose that u(a) <r, 
then since u is upper semicontinuous, there is a neighborhood W of a, such 
that u(a) <r. This implies the existence of a rank N € N with u(u;,) < r for 
any n > N. Then since r, — r we obtain that there exists n € N such that 
u(u;,) <n which is a contradiction. Then it follows that u(a) > r. Similarly 
we can show that u(b) > r so, u(x) > r and then [a,b] C u,. Form (ii), we 
have u, C u,, and it implies u, C [a,b]. Then finally we get u, = [a, 0], i-e., 


Co 
() Ur, = Ur. 
n=1 

(iv) For (iv) we observe that the inclusion 


co 
U Ur, G Uo 
n=1 


is straightforward. Since uo is closed we get 


cl (U «] C uo 


n=1 
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Reciprocally, x € up implies that there is a sequence 
tn € {x ER; u(x) > 0} 


that converges to z. Without loss of generality we may assume that 


CO 


In © Ur, © U Urn: 


n=1 


xecl (U vn) F 
n=1 


The two inclusions lead to the required conclusion. a 


Then we obtain 


The endpoints of the r-level set u, are given by uz = inf u, and ux = sup uy. 
Then also u, = [u;,u;t]. (See Figure [4.]). 


4.2 Characterization Theorems for Fuzzy Numbers 


The following theorem is Negoita-Ralescu characterization theorem, and it is 
the reciprocal of the stacking theorem. 


Theorem 4.8. (Negoita-Ralescu characterization theorem, Negoita- 
Ralescu [115J) Given a family of subsets {M,.:r € [0,1]} that satisfies con- 
ditions (i)-(iv) 

(i) M; is a non-empty closed interval for any r € [0,1]; 

(ii) IfO0<1ry < ro <1, we have M,. C M,,; 

(iii) For any sequence rp, which converges from below to r € (0, 1] we have 


(iv) For any sequence r, which converges from above to 0 we have 


el (U us) = Mp. 
n=1 


Then there exists a unique u € Re, such that u, = M,, for any r € [0,1]. 


Proof. Let MM, fulfill the properties (i)-(iv). Then by defining 


on sup{r € [0,1]|j7e M,} if ce Mp ’ 
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we obtain a fuzzy number (i.e., u is a normal, fuzzy convex, upper semicon- 
tinuous and compactly supported fuzzy set). The level sets of u are u, = M,., 
r € (0,1] and wo C Mo. Now we prove these statements step by step. 
“Normal:” Since Mj is nonempty, for « € M, we have u(zo) = 1, for some 
to € Mo, so u is normal. 
“Fuzzy Convex:” In order to prove fuzzy convexity we consider now a fixed 
element in a fixed interval x € [a,b] C Mo. Suppose that 


u(a) = Ta = sup{rla € M,} 


and 
u(b) = ry = sup{r|b € M,}. 


Suppose that r, <r». Then from (ii) we have M,, C M,., sob € M,, C M,.,. 


Now since both a,b € M,., and since M,,, are closed intervals it follows that 
[a,b] C M,,,. Then 


u(x) > ra = u(a) = min{u(a), u(d)}. 


A symmetric reasoning can be followed in the case when rg > rp. 
“uy = M,” Now let us prove that u, = {xlu(x) > r} = M, by double 
inclusion. Let ro € (0, 1] be fixed and x € M,,. Then ro € {r|z € M,}. Then 


u(x) = sup{r|z € M,} > 19 


and this implies x € u,,. So, we have obtained M,.. C uy,. For the symmetric 
inclusion we consider x € try, i.e., u(x) > ro. Now let us suppose that strict 
inequality u(x) > ro holds. Then sup{r|z € M,} > ro and there exists r, > ro 
with x € M,,. Since M,, C M,, according to (i), we obtain x € M,, which 
completes the reasoning in this case. 
If we suppose 
u(x) = ro = sup{r|z € M,} 


then there exists a sequence r, that converges from below to rp such that 
x €M,,,,n > 1. From (iii) we have 


co 
c€ () My, = Mro. 
n=1 


As a conclusion we obtain u,, C M,,. 50, ur, = My. 

“Upper semicontinuity:” Since u, = M, are closed according to (i) we 
have the complement of u,, that is R \ u, = {x]u(x) < r} an open set. This 
implies that u is upper semicontinuous. 

“Compact support:” It is easy to observe that 


uo = el{alu(x) > 0} = cl J {2lu(x) > rn} =cl LJ Mr, 
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is closed and we have up = Mo. Finally we obtain that uo is a bounded subset 
of the real line. Then, it is compact and the proof is complete. | 


The following pair of Theorems is due to Goetschel and Voxman [74] and 
it gives another representation of a fuzzy number as a pair of functions that 
satisfy some properties. The representation provided by this theorem is called 
the LU (lower-upper) representation of a fuzzy number. 


Theorem 4.9. (LU-representation, Goetschel- Vorman [Q) Let u be a fuzzy 
number and let uy = [uz , ut] = {zlu(x) > r}. Then the functions u-,u* : 
[0,1] > R, defining the endpoints of the r—Ievel sets, satisfy the following 
conditions: 

(i) u(r) =u, € R is a bounded, non-decreasing, left-continuous function 
in (0,1) and it is right-continuous at 0. 

(ii) u*(r) = uxt ER is a bounded, non-increasing, left-continuous function 
in (0,1) and it is right-continuous at 0. 

(iii) uy < uf. 
Proof. For a given u € Re, and given 0 < ry < rg < 1, from the stacking 
theorem we obtain u,, C uy,. Then we have 
< U,. 


- + + + 
u ro Uy Sup Su, <u, 


TL 


Vri,r2, O< ry < rg < 1 which implies immediately the monotonicity prop- 
erties and (iii). Left continuity at r € (0,1] follows from property (iii) of the 
Stacking theorem. Indeed, let ro € (0, 1] be fixed and r,, converging from be- 
low to ro, i.€., Tn t To. Then from the property (iii) of the Stacking Theorem 


we obtain 
co 
() Urn = Uros 


n=1 


which immediately implies uz, > uz, and ut, — uj, ie., both functions are 
left continuous at arbitrary ro € (0, 1]. In order to prove right continuity at 0 
we consider r,, | 0, a sequence that converges from above to 0. We have 


uo = cl{alu(x) > 0} =cl U {zlu(z) >rpn}=cl (U t] ; 


n=1 n=1 


Since uo is compact then it is closed and bounded and we get u,;, — ug and 
uy, — ug, which implies right continuity at 0. rT 
The reciprocal of the LU-representation is the Goetschel- Voxman character- 
ization theorem. 


Theorem 4.10. (Goetschel-Voxman [74] Let us consider the functions u~ ,ut : 
[0,1] > R, that satisfy the following conditions: 

(i) u(r) = uz € R is a bounded, non-decreasing, left-continuous function 
in (0,1) and it is right-continuous at 0. 
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(ii) ut(r) = uxt ER is a bounded, non-increasing, left-continuous function 
in (0,1] and it is right-continuous at 0. 

(iii) uy < uf. 

Then there is a fuzzy number u € Re that has u;,u;t as endpoints of its 
r—level sets, Uy. 


Proof. We will prove that the sets M, = [u,,u;t] satisfy the conditions 
in Negoita-Ralescu characterization theorem and then this family of subsets 
defines a fuzzy number u € Rz. From the monotonicity properties and from 
(iii) we immediately obtain uy, < uz, < uy < uf < ut, < us and this 
implies M,. = [u;,u;‘] are non-empty, closed intervals and that M,, C M,,, 
for any rT; < rg. Let us consider now a sequence r,, which converges from below 
to r € (0,1]. Then from the left continuity properties we obtain u; > uy 
and ut — uf and then we have 


q M,,, = My. 
n=1 


From the right continuity at 0 we obtain 
cd{xe€R:u(«r) >0}= Mo. 
Then there exists u € Rz, such that 


tip = Mi = sas, 


for any r € [0,1]. a 


Remark 4.11. The conditions in the definition of fuzzy numbers are shown 
to be too restrictive in some applications. There are several new research 
directions that are generalizing, revising the fuzzy number concept in different 
directions (see Fortin-Dubois-Fargier [62), Bica [29], etc). This represents an 
interesting topic for further investigation. 


4.3. L-R Fuzzy Numbers 


The so-called Z-R fuzzy numbers are considered important in the theory of 
fuzzy sets. L-R fuzzy numbers, and their particular cases, as e.g., triangular 
and trapezoidal fuzzy numbers, are very useful in applications. 


Definition 4.12. (Dubois-Prade [50/) Let L,R : [0,1] > [0,1] be two con- 
tinuous, increasing functions fulfilling L(0) = R(0) =0,L(1) = R(1) =1. 


60 4 Fuzzy Numbers 


1.075 


0.97 


Fig. 4.6 Example of a trapezoidal fuzzy number 


Letag <a, < ar < ag be real numbers. The fuzzy set u: R — [0,1] is an 
L-R fuzzy number if 


0 if L< apd 
L( — if a <2 <a, 
a ~ 4 : 
u(x“) = i" if ay <@<ayp 
R(4=*) if af Se < a3 
0 af de <2 


Symbolically, we write u = (aj ,a,,a},a¢ where [a;,a}] is the core 
0 9%, 14 5 4 1» Oy 


L,R? 
of u, and a=a, —aj,a= ag _ a; are called the left and the right spread 
respectively. If u is an L-R fuzzy number then its level sets can be calculated 


as 


Ur = [ag +L" (r)a,at — R-*(r)a]. 


As a particular case, one obtains trapezoidal fuzzy numbers when the 
functions L and Rare linear. A trapezoidal fuzzy number u can be represented 
by the quadruple (a, b,c,d) € R*+,a<b<c< d, (see Fig. £6) 


0 if t<a 
fa if a<t<b 


b-—a 

u(t) = 1 if b<t<e 
— if @e<tsd 
0 if d<t 


In this case the endpoints of the r-level sets are given by 
u, =at+r(b—-a) 


and 
ut =d—r(d—c). 
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b 


Fig. 4.7 Example of a triangular fuzzy number 


If we have b = c in the representation (a,b, c,d), the fuzzy number is called 
a triangular fuzzy number. Then a triplet (a,b,c) € R’, a < b < cis 
sufficient to represent the fuzzy number (see Figure [4.7). 


Example 4.13. Let us consider L, R: [0,1] > [0,1], L(x) = R(x) = x?. Let 


a; = af =1 anda =1,a = 2 respectively. Then the L — R fuzzy number 
determined by Definition has the level sets 


ur = [V7r,3 — 27] 
and the shape depicted in Fig. [4.8 


We will consider in what follows other useful classes of fuzzy numbers. 
A Gaussian fuzzy number has the membership degree 


0 if L< 2X1 — ao; 
_ (e=2)? 
e 7 if xvj-—ao,<@r< 2 
U (x) = (x4—2)? ’ 
e. 27 if vy <x24<2,+ 40, 
0 if %,+a0, <2 


where 2 is the core of the fuzzy number, oj, 0; are the left and right spreads 
and a > 0 is a tolerance value. Its graph is shown in Figure Often in 
fuzzy control applications we have a + oo in which case the fuzzy set is not 
a fuzzy number since it fails to have a compact support, however it is very 
useful in fuzzy control systems. 
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Fig. 4.9 Example of a Gaussian Fuzzy number 


An exponential fuzzy number has the membership degree given by 


0 if u< 2, — aT, 

Par 

e 7 if ay-—aTy<x<2x 
u(x) = Pn 1 bo 1 , 


evr if a, <u <a +aT, 
0 if a tat, <2 


where 2, is the core of the exponential fuzzy number 7, 7, are the left and 
right spread of it respectively, and a represents a tolerance value. Its graph 
is shown in Figure [4.10] 
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zy 


A(x) 
° 
L 


Fig. 4.10 Example of an exponential fuzzy number 


Remark 4.14. In some applications, to have a compact support is not im- 
portant. Then we will consider fuzzy sets that are not fuzzy numbers in the 
proper sense of the term, but they are very simple and useful in applications. 
Moreover, if e.g. the Universe of discourse is restricted to a closed compact 
interval, then all the fuzzy sets that fulfill (i), (1) and (wi) of Definition 4.1 
become fuzzy numbers. As examples of such fuzzy sets we mention fuzzy sets 
with Gaussian membership function 


(w-21)? 
u(z) =e— at 


and fuzzy sets with exponential membership function 


_ le=211 


u(z) =e 7 


Remark 4.15. In this section we investigated L — R fuzzy numbers, which 
were based on Negoita-Ralescu characterization. Similarly L —U_ representa- 
tion of fuzzy sets was recently investigated in several papers as e.g., Stefanint- 
Sorini-Guerra[137, Stefanini[135]. Another interesting idea 
within the topic of the present chapter is the problem of approximation of a 
fuzzy number by trapezoidal or other types of fuzzy numbers (Grzegorzewski- 
Mr6wka [75], Ban-Coroianu-Grzegorzewski[11]). 


4.4 Problems 
1. Prove that if u is an L-R fuzzy number then its level sets are given by 


ur = [ag +L7* (r)a,at — R7 (r)a] ,r € [0,1]. 
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In the definition of an ZL — R fuzzy number the functions LD and R are 
considered increasing L, R : [0,1] — [0,1]. Considering however L, R two 
decreasing functions would allow us to give an alternative definition of 
the LZ — R fuzzy number concept. Write the membership function of an 
L — R fuzzy number based on decreasing functions L, R. Find the level- 
sets of the fuzzy number obtained by this definition. Show examples of 
L— R fuzzy numbers of this type. 


Write the membership function and find the level sets for a general trian- 
gular fuzzy number u = (a, b,c), then use the results to find the member- 
ship function and the level sets, for the particular case of the triangular 
fuzzy number (2, 4,5). 


Write the membership function for the L-R fuzzy number in Example 
and prove that its level sets are given by 


Ur = [Vr,3— 277] . 


Given the sets M, = le +e", 4e — "| show that these sets define a 


fuzzy number such that u, = M,. Find the expression of the membership 
function of u. 


Set up triangular, Gaussian and exponential membership functions for 
fuzzy sets that model the linguistic expression “about 100”. 


Find an expression for the level sets of a Gaussian fuzzy number. 
Find an expression for the level sets of an exponential fuzzy number. 


Consider L(x) = R(x) = «*,a > 0. Write the membership function and 
find the level sets of the Z — R fuzzy number based on these functions. 


Find a function of the form a+b6cos(cx+d) such that L, R will be correct 
shape functions for an LZ — R fuzzy number and additionally, such that 
the ZL — R fuzzy numbers that we obtain will have smooth membership 
functions. Write the membership function and the level sets of the D— R 
fuzzy number obtained. 


5) 
Fuzzy Arithmetic 


5.1 Zadeh’s Extension Principle 


Often, we have to perform operations with uncertain parameters. In this 
case we will have to define the fuzzy counterparts of the classical operations 
between real numbers. 

We begin our discussion on fuzzy arithmetic with Zadeh’s extension prin- 
ciple. It serves for extending a real-valued function into a corresponding fuzzy 
function. 


Definition 5.1. (Zadeh’s Extension Principle, Zadeh [156)) Given a func- 
tion f : X — Y, where X and Y are crisp sets, it can be extended to a 
function F : F(X) > F(Y) (a fuzzy function) such that v = F(u), where 


ee { sup{u(x): a € X, f(z) =y}, when f-'(y) #2 


0, otherwise 


We call the function F as Zadeh’s extension of f. 


Remark 5.2. Zadeh’s extension is well defined for any fuzzy set uc F(X). 
Indeed, when f~'(y) # @, the set {u(x): x € X, f(x) = y} is non-empty and 
bounded and so, it has a least upper bound. 


Naturally raises the question whether a fuzzy number in the input generates 
a fuzzy number in the output. 


Theorem 5.3. (Nguyen [116J, Barros-Bassanezi-Tonelli [12], Fullér- 
Keresztfalvi [65/) Given a continuous f :R — R, it can be extended to a fuzzy 
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function F : Rr > Re, and given u € Re we can determine v = F(u) € Re 
by its level sets v, = F(u,), Vr € [0,1], .e., we have v, = [v, ,u,], where 


v, =inf{f(a)|a € u,-} 
ut = supff(e)|e € ur}. 


ur, r € [0,1] denote the level sets of u. 


Proof. First let us prove that if u, and v,; are level sets of the fuzzy sets u 
and v = Fu) respectively then uv, = f(u,). 
The case f~!(y) = @ is obvious. If f~!(y) 4 @ we have v = F(u) given as 


v(y) = sup{u(2)|a € X, f(x) = y}- 


Ifa € u, then u(x) > r and it implies also that v(y) > r and so y = f(x) € v,, 
ie., f(u,r) C vp. On the other hand if u(y) > r then for any ¢ > 0 there exists 
an x € f~*(y) such that 

u(y) —€ < u(x) 


which implies u(x) > r and so, we obtain that Zadeh’s extension satisfies 
vr © f (ur) so finally v, = f(u,). So, if v- = [up , ut], we obtain 


v, = inf{f(x)|x € u,} 
ut = supff(e)|e € ur}. 


Let us prove now that if u, are level sets of a fuzzy number u € Re then 
vy = f(u,) define level sets of a fuzzy number v € Rez, v = F(u). For 
this aim we will prove that v, satisfy the hypotheses of the Negoita-Ralescu 
characterization. First we observe that since u, are compact convex intervals 
in R and since f is continuous, we get v, = f(u,) compact convex. This 
means that vu, is a closed interval for any r € [0, 1]. 

If r < s then we have u, C u,. This implies 


Us = f (us) c f(ur) = Ur. 


Let us consider the sequence r,, that converges from below to r. Then 


co 
() Ur, = Ur. 
n=1 

We will prove that 
co 
() Urn, = Ur, 
n=1 


Le€., 


() f(ur,) = fur) 


n=1 
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which is equivalent to 


Let 


Then there exist an x € u,y,,Vn = 1,2,... such that y = f(x). Then y € 
f(uy,,), Vn = 1,2,..., Le, 


On the other hand let 
YE () f(ur,.). 
n=1 


Then y € f(ur,),Vn = 1,2,... Then there exists an v, € u,,with y = 
f(xn), Vn = 1,2,... Since x, is a bounded sequence and since 2, € uo 
with wo compact, we get the existence of a sub-sequence r,,,kh = 1,2,... 
that converges. Let 7 = limp_+oo Yn,. It is easy to see that « € u,. Indeed, 
Ur © Ur,, Vn = 1,2,... and if we suppose that x ¢ u, we get that there exists 
k such that x ¢ uz. Taking into account that x = limp. fn, we obtain a 
contradiction. 
Combining the two inclusions we obtain 


oe) 
() ome = re. 
n=1 


Let us consider the sequence r, that converges from above to 0. Then it is 


known that 
cl (U w.] = Uo- 
n=1 


It is easy to check that since f is continuous we have f(cl(A)) C cl(f(A)), 
and then 


w-1(e(Bo)) «(Goms)-o(Q) 


which immediately implies 


68 5 Fuzzy Arithmetic 


and so, the hypotheses of Negoita-Ralescu characterization theorem are ful- 
filled. Using the theorem we have proved that v,; are level sets of a fuzzy 
number, i.e., v € Re. | 


The two dimensional case of Zadeh’s extension principle is very important 
because it allows us to extend operations between real numbers to the fuzzy 
case. 


Definition 5.4. In the case of two variables (f :X x Y + Z ) the function 
can be extended to F : F(X) x F(Y) > F(Z) such that w = F(u,v), where 


oe sup {min{u(zx), v(y)} f(2,y) =z} if f(z) #@ 


ceEX,yEeY 
0, otherwise 


Remark 5.5. We should exercise however caution, because there are pitfalls 
as it was shown in Huang [78). Namely, an extension principle based on 
compact conver subsets of R? is not possible. The following correct extension 
result allows us to extend real operations to the fuzzy number’s case. 


Theorem 5.6. (Nguyen [116J, Barros-Bassanezi-Tonelli [12], Fullér- 
Keresztfalvi [65/) If we assume that f : Rx R > R, continuous, then we 
can extend it to F : Re x Rr > Rp such that w = F(u,v) has its level sets 


wr ={f(x,y)|@ € ur,y € Ur}. 
for any u,v E Re, ie. if wp = [wr , wt] then 


w, = inf{ f(x, y)|@ € Ur, y € vp} 


oes 


w, =sup{f(x,y)|z € ur, y € Ur}. 


Proof. First let us prove that if u,,v, and w, are level sets of the fuzzy sets 
u,v and w = F (u,v) respectively then w, = f(ur, Ur). 
The case f~!(z) = @ is obvious. If f~!(z) # @ we have w = F(u,v) given 
as 
w(y) = sup{min{u(zx), o(y)} :@ € X,y €Y, f(ey) = 2}. 


If x € ur, y € Uy then u(x) > r, v(y) > r and for z = f(x,y) it implies also 
that w(z) > rie, f(ur, vr) C wr. On the other hand if w(y) > r then for 
any € > 0 there exists an (x,y) € f~+(z) such that 


w(z) —e < u(x) and w(z) —« < u(y) 


which implies u(x) > r and u(y) > r so, we obtain w, = f(u,;,v,). From now 
on the reasoning is similar to that of the preceding result. 

Since u,,v, are compact convex intervals in R and since f is continuous, 
we get w, = f(u,,v-) compact convex. 
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If r < s then we have u, C u, and v, C v;. This implies 
Us = f (us, Us) Cc f (ur, Ur) = Ur. 
Let now r,, be a sequence that converges from below to r. Then the relations 
co 
() Wr, = Wr 
n=1 


can be obtained in a similar way as in the previous theorem. Finally, if rp, 
converges from above to 0 we get 


wo = cl (U vs] : 
n=1 


and so, the hypotheses of Negoita-Ralescu characterization theorem are ful- 
filled and finally we obtain w € Re. a 


5.2. The Sum and Scalar Multiplication 


For u,v € R¢ and A € R, based on the extension principle, one can define 
the sum of two fuzzy numbers u+ v and the multiplication between a real 
and a fuzzy number A- u. Then by Theorem |5.6) since the sum and scalar 
multiplication are continuous functions, we obtain, 


(U+U)p = {z+ y|@ E Ur, y E Up} = Up + Up, 


(A: u), = {Az|ax € ur} = Aur, Vr € [0,1], 


where u, + uv; is the sum of two intervals (as subsets of R), and Au, is the 
usual product of a number and a subset of R. So, fuzzy arithmetic extends 
interval arithmetic. 


Example 5.7. Let wu = (1,2,3), v = (2,3,5) be triangular fuzzy numbers 
then u+v = (3,5,8). Also we have 2u = (2,4,6) and —2v = (—10, —6, —4). 


The following Theorem deals with the algebraic properties of R-. 
Theorem 5.8. (Anastassiou-Gal [5/, Dubois-Prade [50/, Gal [69/) (i) The 


addition of fuzzy numbers is associative and commutative i.e., 
utv=v+u 


and 
ut+t(v+w)=(utv)+u, 


Vu,v,w € Re. 
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(ii) The singleton fuzzy set 0 = Xo} € Re is the neutral element w.r.t. + 
1.€., 
u+0=0+u=u, 


for any u€ Re. 
(iti) None of u€ Rz \R has an opposite in Re (w.r.t. +). 
(iv) For any a,b € R with a-b>0 and any u € Re, we have 


(a+b)-u=(a-u)+(b-u). 


For general a,b € R, this property does not hold. 
(v) For any X€R and u,v € Re, we have 


A+ (utv)=rA-u+tA-v. 
(vi) For any \, 4 € R and any u € Re, we have 
(A: p)-u=A- (uu) 


Proof. The properties are easy to be verified. Also, it is easy to see that 
(2—1)(1, 2,3) = (1, 2,3), while 2(1, 2,3) — (1, 2,3) = (—1, 2,5), where u—v = 
ut (-1)v. r 


As a conclusion from the previous Theorem we obtain that the space of fuzzy 
numbers is not a linear space. 


5.3 The Product of Two Fuzzy Numbers 


The product w = u-v of fuzzy numbers u and v, is defined (see e.g. Hanss 
[77]) based on Zadeh’s extension principle. Using again Theorem[5.6] we have 
it defined by its endpoints as 


w, =inf{x-yle € ur, y € ur} 


wt = sup{z: y|z € ur, y € ur}. 


The product attains its extrema at the corners of its domain. Then, 


(u : Oe = min{u, Up , Up Up » Up Up , Up up } 


and 


+ te = 
Up Up > Up Up , Up Up }. 


(u ; wy) = max{u,, Up 5 


Example 5.9. As an example, consider u = (0,2,4,6) and v = (2,3,8). 
Then the endpoints if the level sets of u-v are 


(u-v), = 2r-(r+2) 
(u-v)* = (6 — 2r) -(8—5r) 


which leads (u-v)1 = [6, 12], (u-v)o = [0, 48], and membership function shown 
in Figure [5.1 


z 2 
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The following Theo 
the multiplication. 


Fig. 5.1 Product of two fuzzy numbers 


rem discusses the algebraic properties of R¢ related to 


Theorem 5.10. (i) The singleton fuzzy set 1 = x41} € Re is the neutral 


element w.r.t. + 7.€., 
(ii) None of u € 1 
(iit) For any u,v 


u-l=1-u=u, for anyu€ Re. 
Rz \R has an inverse in Re (w.r.t. -). 
,w € Rez we have 


((u4 


tu): wr C (u-w), + (vw), Vr € [0, 1], 


and, in general, distributivity does not hold. 
(v) For any u,v,w € Re are such that none of the supports of u,v,w does 
not contain 0, we have 


u:(u-w)=(u-v)-w. 


Proof. The properties are easily verified. Let us prove (iii). From Theorem 


[5.6] we have 


((u+v)-w), = min{(u; +u,) Why (Us, 07) 


Ww 
> min{u, -w, 


+min{v,. 


+ 


Tr? 


(ud + uf) - wy, (ut + uf) - wt} 


+ +, 


reer 


Up 


Wey Ue Wy Ue «We 


ro? 
+ 
r) 


{ 
T 
U Tr 


dhe «gat 
Wy ,Up * W Oe ag ae 


which combined with the symmetric inequality leads to 


((utv)-w)p C (u-w), + (v-w),, Vr € (0, 1]. 
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Zadeh’s extension based product has certain disadvantages. The most impor- 
tant one is that the product of two triangular or trapezoidal fuzzy numbers is 
not triangular trapezoidal, etc. To improve on this aspect the cross product 
of fuzzy numbers was proposed in [8], [9] and [I]. 

We will say in this following discussion that a fuzzy number is positive if 
for the lower endpoint of its core we have w, > 0. Also we call a fuzzy number 
negative if wf <0. Let us denote by R* the set of positive or negative fuzzy 
numbers, i.e., 


R> = {w € R-|0 ¢ int(w1)}, 
where int(w ,) denotes the set of interior points of wy. 


Proposition 5.11. (Ban-Bede [8], [9, Bede-Fodor [T7]) If u and v are pos- 
itive fuzzy numbers, then w = u© v defined by w, = |w,, wt], where 


Wp =U, Vy + Uy U, — Uy Vy 


and 


| | { | 
Ww, =Upvy + uf vu, a up vy, 


for every r € [0,1], ts a positive fuzzy number. 


Proof. We have 


t+ufut —ujpv, > 0, 
for every r > 0, and so w, = [w;,w;t], is a closed interval. This verifies (i) 
in Theorem [4.8] 
Let us consider 71,72 € [0,1] ,71 < rg. Because u,, C u,, and u;, C Up, we 
obtain 


Wp, = Up, Vp + Uy Up, — Uy Vy 


LU, Vy + Uy vu, — Up Uy = w,, 


and 


a 
TL 


+ ay +, Pad 
w Up, Up + Uy Up, — Uy VY 


< who + it UE, —ufot = TEE 
which implies (ii) of Theorem [4.8] 
Let us consider (rn),cn converging increasingly to r € [0,1]. The condi- 
tions in Theorem [4.8] imply 


Up Uy UU, — Uy \ U,V, +Uypy, — Uz v, 


and 


tad tad bat +4 tat a tay 
Up Uy HU Up, — UU, A U;pYy HULU, — Uz YY. 


such that we obtain (iii) of Theorem [4.8] The proof of (iv) is similar to (iii). 
The conclusion of the Theorem is that the level sets w, define a fuzzy 
number. a 
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Proposition 5.12. Let u and v two fuzzy numbers. 
(i) If u is positive and v is negative then 


uOuv=—(ue(-»)) 


is a negative fuzzy number. 
(ii) If u is negative and v is positive then 


uOuv=—((-u) Ov) 


is a negative fuzzy number. 
(iit) If uw and v are negative then 


uOv=(—u)O (-») 
is a positive fuzzy number. 


Proof. It is left to the reader as an exercise. | 


Definition 5.13. (Ban-Bede [8]) The binary operation on R*- introduced as 
above is called the cross product of fuzzy numbers. 


The cross product is defined for any fuzzy numbers in 
R> = {u € R¥; there exists an unique zp € R such that u (29) = 1}, 


therefore it is well defined for triangular fuzzy numbers. 


Example 5.14. The cross product of two positive triangular fuzzy numbers 
u = (a1, 61,c1) and v = (ag, ba, c2) is 


UOVU= (azbe + agb1 — by bo, by be, bic2 + boc, — bic1). 
For example if u = (2,3,4) and v = (3,4,6) is 


u©v = (5,12, 22). 


5.4 Difference of Fuzzy Numbers 


The standard difference induced by Zadeh’s extension principle, has the prop- 
erty u—u #0. This is a shortcoming in some theoretical results and appli- 
cations of fuzzy numbers. To avoid this shortcoming several new differences 
were proposed. 

Definition 5.15. (Hukuhara [79], Puri-Ralescu [123]) The Hukuhara differ- 
ence (H-difference Oy) is defined by 


UOHFV=WSuUu=dU+NU, 


being + the standard fuzzy addition. 


74 5 Fuzzy Arithmetic 


If u Og v exists, its a — cuts are 
[u Ox VJa = [ua — Va, Ua — Va): 


It is easy to verify that uOy u = 0 for any fuzzy numbers u, but as we have 
earlier discussed u — u 4 0. 

The Hukuhara difference rarely exists, so several alternatives and general- 
izations were proposed as e.g. the generalized Hukuhara differentiability. 


Definition 5.16. (Stefanini [136), Stefanini-Bede [1{1)) Given two fuzzy 
numbers u,v € Rg, the generalized Hukuhara difference (gH-difference for 
short) is the fuzzy number w, if it exists, such that 


: (i) usv+y 
uoproaw ty (ii) v=u-—w 


In terms of a-cuts we have 
Proposition 5.17. For any u,v € R¢ we have 


[u Ogu Ya = [min{us — vg jut — ot}, max{uy — ug ,ut — of}. 


Proof. The proof is left to the reader as an exercise. = 


The level-wise expression that we have obtained is the interval arithmetic 
proposed in Markov [108], [109]. 


The generalized Hukuhara difference exists in many more situations than 
the usual Hukuhara difference, but it does not always exist. We consider the 
following generalized difference (g-difference) that presents some advantages. 


Definition 5.18. (Stefanini [136], Bede-Stefanini [27])The generalized dif- 
ference (g-difference for short) of two fuzzy numbers u,v € Re is given by its 
level sets as 


[u UOgv vla = el LJ ((u ule Ogun |v ve eee [0,1], 
Bea 


where the gH-difference Ggx 1s with interval operands [u]g and [v]g and it is 
well defined in this case. 


Proposition 5.19. (Bede-Stefanini [27]) The g-difference is given by the 
expression 


[U Og Vila = ae min{ug _ Ug Ug _ v5}; eg max{ tg — U6 us - v5} 
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Proof. Let a € [0,1] be fixed. We observe that for any 6 > a we have 


[ula Ogu [v]a = [min{us - Ug UB - v3 },max{ug - Ug UB - v5} 


Cc 


inf min{uy — vy, uy — vy },supmax{uy — vy, uy — vy} 
AzB A>B 


and it follows that 


cl J ([u]s Sour ula) 


B2a 


C | inf minf{uz —vz,us — vt}, sup max{u, —vg,ut —vt 
< | js {ug — Up» Up a}, sup {ug — Ug .Ug — UB t 
Let us consider now 


el |_) (lula Sox (Ja) 
B>a 


=cl U [min{u5 — Ug Up - v3 },max{ug - Ug UB - v5} : 
Bea 


For any n > 1, there exist 
An € {ug — Ug ,ug — Ug :8>a} 
such that 
ae min{ug — Ug ,Ug — vg} > an — 


Also there exist 


bn € {ug — vg, ug — 0g : 8 >a} 
such that ‘ 
— ,+ + 
sup max{uz —vU3,U, —vg}<bz4+ -. 
{ug — Ug stg — UB} <bn+— 


We have 
el LU (u ule Ogu [v]g) 2 [an, bn], Vn > 1 
Bra 


and we obtain 


cl L ([u ulg Ogu [v]a) 2 U [Qn, bp] D ( lim dp, lim bn) 


n—0o n 
Bra n>1 


and finally 


cl |_) (lule Ogu (ula) 
B>a 


> | inf minfuz —v7,ut — vt}, sup max{u, —v7,ut —vt}]. 
>a {ug — Ug Up 3, Sup {ug —Ug.Ug — Ug} 
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The conclusion 


inf minfu, —v,,ut —vt},supmax{u, —v,,ut — vt 
Anf min{ug — Ug 1Up pe {Ug — Ug stg — Ye} 


of the proposition follows. | 


Proposition 5.20. For any fuzzy numbers u,v € Re the g-difference uO, v 
exists and it is a fuzzy number. 


Proof. According to the previous result, if we denote w- = (uG,v) and 
wt = (uO, v)* we have 


w (a) = _ min{ug — vz, Up - v3} 


< wt (a) = sup max{ug — Ug, up -_ v3 }- 

Bea 
Obviously w7 is bounded and non-decreasing while w* is bounded non- 
increasing. Also, w~ , wt are left continuous on (0, 1], since w= — uv, ut — vt 
are left continuous on (0,1] and they are right continuous at 0 since so are 
the functions u~ — v~,ut — vt. = 


Example 5.21. Consider the trapezoidal u = (2,3,5,6) and the triangular 
v = (0,4,8) fuzzy numbers. It is easy to see that their gH-difference does not 
exists. Indeed, if we suppose the contrary then we need to have 


+ 


= = + 
Uaq — Va < Ug — Va 


simultaneously for every a € [0,1] or 


+ 


= oa of 
Ua — Va 2 Ug — Va 


simultaneously for every a € [0,1]. But we observe that 
2=Up — Vo >ud —uf =-2 


while 
-l=u, -—v <uj —of =1. 
Since the same inequality should hold for every a € [0,1], we obtain a 
contradiction. 
From the previous proposition the g-difference always exists so it exists and 
it is given as in Fig. [5.2] 
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Fig. 5.2 The g-difference of two fuzzy numbers 


5.5 Problems 


1. Let u = (2,5,6,7) and v = (1,4,5) be a trapezoidal and a triangular 
fuzzy number. Calculate u+v, u—v, —2u+4v, u—u and 2u — v. 


2. Prove the properties in Theorem[5.8} (Hint: you can prove that the prop- 
erties are true for every level set). 


3. Find the product of the trapezoidal and triangular fuzzy numbers u = 
(2,5,6,8), v = (1,4, 5). 


4. Find an expression for the level-sets of the product of two triangular fuzzy 
numbers u = (a1, b1,¢1) and v = (ag, be, c2), knowing that a, a2 > 0. 


5. Find an expression for the level-sets of the product of two Gaussian 
fuzzy numbers u,v € Ry with left endpoints of their level sets ug , 
Up > 0. 


6. Find an expression for the level-sets of the product of two exponen- 
tial fuzzy numbers u,v € R- with left endpoints of their level sets ug , 
Up > 0. 


7. Prove Proposition 


8. Prove that the cross product of two positive trapezoidal fuzzy numbers 
u = (a1, 61,¢1,d,) and v = (ag, be, C2, da) is 


UO V = (a1bg + agby — bybe, bi be, c1c2, c1dg + cody — c1€2). 


Calculate the cross product with u = (2,3,4,5) and v = (3,4, 6,8). 
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9. 
10. 


11. 


12. 


13. 


14. 
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Find the Hukuhara difference u © v, where u = (2,5,6,8), v = (1,4,5). 


Find the generalized Hukuhara difference u GQ gH v, where u = (1, 2,3), 
v = (1,3,5). Does their Hukuhara difference exist? 


Prove that the generalized Hukuhara difference uO, v, of two triangular 
fuzzy numbers u, v always exists. Find an expression for the gH-difference 
for this case. 


Find the generalized difference uO, v, where u = (0, 2,4), v = (0,1, 2,3). 
Does their gH-difference exist? 


Find the generalized difference uG,v, where u = (4,5, 6,8), v = (0,5, 10). 
Does their gH-difference exist? 


Prove Proposition 5.17] 


6 
Fuzzy Inference 


Reasoning with imprecise information is one of the central topics of fuzzy 
logic. A fuzzy inference system consists of linguistic variables, fuzzy rules 
and a fuzzy inference mechanism. Linguistic variables allow us to interpret 
linguistic expressions in terms of fuzzy mathematical quantities. Fuzzy Rules 
are a set of rules that make association between typical input and output 
data sometimes in an intuitive way, or, on other occasions, in a data driven 
way. A fuzzy inference mechanism is able to model the process of approx- 
imate reasoning, through interpolation between the fuzzy rules. Of course 
good interpolations are also approximations, and in this way approximate 
reasoning is performed. 


6.1 Linguistic Variables 
Definition 6.1. (Zadeh [156]) A linguistic variable is a quintuple 
(X, T, U, G, M) 


where 

X is the name of the variable 

T is the set of linguistic terms which can be values of the variable 

U is the universe of discourse 

G is a collection of syntax rules, grammar, that produces correct expres- 
sions in T. 

M is a set of semantic rules that map T into fuzzy sets in U. 


B. Bede: Mathematics of Fuzzy Sets and Fuzzy Logic, STUDFUZZ 295, pp. 79 
DOI: 10.1007/978-3-642-35221-8 6 © Springer-Verlag Berlin Heidelberg 2013 
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We can see from the previous definition that a linguistic variable works as a 
dictionary that translates linguistic terms into fuzzy sets. Often we use the 
term linguistic variable for a given value of the linguistic variable and also, if 
confusion is avoided, we use the same term for the fuzzy set that is associated 
to it, ie., if A is a fuzzy set that is associated through a semantic rule to an 
instance of a linguistic variable, then we say that A is a linguistic variable. 


Example 6.2. We consider an example of a linguistic variable (Age,T, U, 
G,M) where 

X = Age. 

T = {young, very young, very very young, ...} 

U = [0,100] is the universe of discourse for age. 

G: The syntax rules can be expressed as follows: young € G. Ifx € G then 
very x eG. 

M:T- F(X), M(young) = u, where u = (0,0, 18, 40). 

M(very” young) = u"(«). 


As the previous example pointed out linguistic terms are sometimes composed 
of two parts. A fuzzy predicate (young, smart, small, tall, low) and modifiers 
(hedges) (very, likely, unlikely, extremely). Hedges may be interpreted as a 
composition between a given function and a basic membership function. 


Example 6.3. We consider an example linked to room temperature control 
(Temperature,T,U,G,M) where 

X = Temperature. 

T = {cold, very cold,...cool, very cool,...,....,hot, very hot,...}. 

U = [40,100] is the universe of discourse for temperature. 


ze 4 
x 05 


Fig. 6.1 Example of fuzzy values of a linguistic variable 
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Fig. 6.2 Modifiers with linguistic variables 


G : The syntax rules can be expressed as follows: cold, cool, just right, 
warm, hot € G. Ifa € G then very x € G. Let us observe that very warm# hot, 
they have different membership functions. Also, the expression very just right 
is correctly obtained by applying the hedge very to just right. It is a correct 
expression in our syntax however the linguistic term for it is not used in 
natural language. 

M:T > F(X), M(cold) = wu, where u; = (40, 40, 50,60), M (cool) = ua, 
where uz = (50,60, 70), ..., M(hot) = us, where us = (80, 90, 100, 100). 

M (very cold) = ul}(x),..., M(very"hot) = uf (x). See Figures 6.1 


6.2. Fuzzy Rules 


Fuzzy rules (fuzzy if-then rules) are able to model expert opinion or com- 
monsense knowledge often expressed in linguistic terms. The intuitive associ- 
ation that exists between given typical input data and typical output data is 
hard to be described in a mathematically correct way, because of the uncer- 
tain, often subjective nature of this information. Fuzzy rules are tools that 
are able to model and use such knowledge. 

A fuzzy rule is a triplet (A, B, R) that consists of an antecedent A € F(X), 
a consequence B € F(X) that are linguistic variables, linked through a fuzzy 
relation R€ F(X x Y). 

Using fuzzy sets a fuzzy rule is written as follows: 


If x is A then y is B 
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Example 6.4. An example of a fuzzy rule that naturally can be considered 
in the room temperature control problem is the following: 


If temperature is cold then heat is high 


It is a natural idea to interpret fuzzy rules using fuzzy relations, since any 
rule is a natural expression of a relationship between the input and output 
variable. The fuzzy relation is obtained by a composition of the antecedent 
and consequence. 


Definition 6.5. (Mamdani-Assilian [107]) We define the fuzzy rule 
Ifx is A then y is B. 


as a fuzzy relation as follows 
(i) Mamdani rule: 
Ru(2,y) = A(z) A Bly); 
(ii) Larsen rule: 


Rr(z,y) = A(z) - B(y); 


(iii) t-norm rule: 


Rr(a,y) = A(@)TBy), 


with T being an arbitrary t-norm. 
(iv) Godel rule: 
Ra(2,y) = A(x) > Biy), 


with — being Godel implication; 
(v) Gédel residual rule: 
Rr(z,y) = A(z) >r Bly) 
with +7 being a residual implication with a given t-norm. 


Example 6.6. An example of a fuzzy rule interpreted as a fuzzy relation 
is represented in Fig. Two Gaussian fuzzy sets A : [0,1] > [0,1] and 
B: [0,1] > [0,1] are considered with £1 = 0.6 and a, = 0.1 being the mean 
and spread of A, while Zz = 0.4 and o2 = 0.1 are the mean and the spread 
of B. 


Remark 6.7. In many applications a fuzzy rule will have several antecedents 
that are used in conjunction to build our fuzzy rule. For example a more 
complex fuzzy rule can be considered 


Ifa is A andy is B then z is C. 
In this case the antecedents are naturally combined into a fuzzy relation 


D(x, y) = A(a) A B(y) 
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Fig. 6.3 A fuzzy rule interpreted as a fuzzy relation 


that is regarded as a fuzzy set on its own. Then the fuzzy rule uses the an- 
tecedent D. For example, in this case the Mamdani rule will be 


Ru(a,y,2) = A(x) A Bly) A C(z). 


Between the antecedents we can use a general fuzzy conjunction (t-norm) but 
we do not have usually an implication between the antecedents since they are 
not in a cause effect relation with each-other. So, for example when a fuzzy 
rule with more antecedents is transformed into a fuzzy relation we can define 
the Godel rule as 


Re(2,y, 2) = A(x) A Bly) > C(2). 


6.3 Fuzzy Rule Base 


A single fuzzy relation is barely enough to make an informed decision. Often 
in applications we will have a fuzzy knowledge base or fuzzy rule base, i.e. 
a finite collection of fuzzy rules. 


Example 6.8. Fuzzy rule bases are able to express expert or commonsense 
knowledge 
If temperature is cold then heat is high 


If temperature is cool then heat is low 


If temperature is just right then heat is off 
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If temperature is warm then cool is low 
If temperature is hot then cool is high. 


A fuzzy rule base can be expressed as a sequence of fuzzy rules 


If temp is A; then heat/cool is B;, i =1,...,n. 


We saw in the previous section that it is natural to translate one fuzzy rule 
into a fuzzy relation. In a similar manner, a fuzzy rule base can be translated 
into a fuzzy relation. The fuzzy relation is obtained by a max-min type or a 
min— type composition of the antecedents and consequences. 


Definition 6.9. (Mamdani-Assilian [107]) We define the fuzzy rule base 


If x is A; theny is By, i=1,...,n. 


as a fuzzy relation as follows: 
(i) Mamdani rule base: 


n 


Ru(z,y) = V Aj(x) A Bi(y) 


i=1 
(ii) Larsen rule base: 


n 


Ri (x,y) = \f Ai(a) - Bily) 


i=1 
(iii) maz-t-norm rule base: 


n 


Rr(z,y) = \V Ai(x)TBi(y), 


i= 


with T being an arbitrary t-norm 
(iv) Gédel rule base: 


n 


Re(z,y) = (\ Ai(z) > Bily), 


i=1 


with + being Godel implication 
(v) Gédel residual rule base: 


n 


Ra(a,y) = (\ Ai(x) +7 Bay), 


i=l 


with +7 being a residual implication with a given t-norm T. 
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Fig. 6.4 The Mamdani rule base 


Remark 6.10. As individual rules may have more antecedents linked 
through conjunctions we can have the same situation for a fuzzy rule base 


Ifa is A; and y is B; then z is Ci,i =1,...,n. 


In this case the antecedents are combined into a fuzzy relation A;(x) A B,(y). 
Then the Mamdani rule will be 


n 


Ru(a,y,2) = \V Ai(x) A Bi(y) A Ci(2). 


i=1 


Between the antecedents we do not have an implication, instead we will have 
conjunction or eventually a t-norm. So, when a fuzzy rule base with more 
antecedents is translated into a fuzzy relation we obtain the Godel rule base 
as 


Ra(e,y,2) = \ Ai(x) A Bi(y) > Ci(2). 


Example 6.11. Considering the temperature control ecample described above, 
the output can be scaled on the [—2,2] interval (—2 being the strongest cooling 
and 2 stands for the strongest heating. The consequences B,,...,Bs5 are tri- 
angular fuzzy numbers B, = (—2,—2,—1), Bo = (—2,—1,0), Bs = (—1,0,1), 
By = (0,1,2), Bs = (1,2,2). The Mamdani rule base can be represented as 
in Fig. The Godel rule base of the same example is shown in Fig. 


Remark 6.12. We can see that there is not a unique way to interpret a 
fuzzy rule or a fuzzy rule base. This seems to be a drawback of fuzzy inference 
systems at first sight. We can turn this into an advantage because it gives us 
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Fig. 6.5 The Gédel rule base 


increased flexibility. Indeed, mainly in practical problems, it is an advantage 
to have more flexibility and to be able to select the method that best fits our 
problem. 


6.4 Fuzzy Inference 


Fuzzy inference is the process of obtaining a conclusion for a given input 
that was possibly never encountered before. The basic rule (law) for a fuzzy 
inference system is the compositional rule of inference (Zadeh [155}) It 
is based on the classical rule of Modus Ponens. Let us recall first the classical 
Modus Ponens of Boolean logic: 


premise: if p then q 
fact: p 
conclusion: q 


Given a fuzzy rule or a fuzzy rule base R € F(X x Y), the compositional 
rule of inference is a function F : F(X) — F(Y) determined through a 
composition B’ = F(A’) = A’ * R, with *: F(a) x F(X x Y) > F(Y) being 
a composition of fuzzy relations. 
The compositional rule of inference consists of a 
premise: if x is A; then y is B;,i =1,...,n 
fact: xis A’ 


conclusion : y is B’ 
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Definition 6.13. (Mamdani-Assilian [107 see also e.g. Fullér [é4y, Fullér 
[6€3)) We define a fuzzy inference based on a composition law as follows: 
(i) Mamdani Inference: 


B'(y) = A’ o R(z, y) = VV A(z) )A R(a,y) 


TEX 
(it) Larsen inference: 
B’(y) = A’ o, R(a,y) = A’ (x Y) 
LEX 


(iit) Generalized modus ponens or t-norm-based inference: 


B'(y) = A’ or R(az,y) = VV A (a )T R(a, y) 
cEX 


with T being an arbitrary t-norm. 
(iv) Gédel Inference 


By) = A's R(x, y) = NAG )> R(a,y) 
vex 


with + being Godel implication. 
(v) Gédel residual inference 


B'(y) = A’ <r R(z, y) =. A'(x) +r R(x, y) 
rEeX 


with +7 being a residual implication with a given t-norm. 
Throughout the definition, R(x,y) is a fuzzy relation that is used for in- 
terpreting the fuzzy rule base in the premise. 


Remark 6.14. We can combine the above rule bases with any inference tech- 
nique given in the previous definition. The combination that is most closely 
matching our real-world problem can be chosen or can be adaptively calcu- 
lated. 


Remark 6.15. As previously discussed we may have a fuzzy rule base with 
more antecedents, so we also need a fuzzy inference system to be able to deal 
with more antecedents. This is possible to be done by using the same strategy 
to combine the premises as the one used for the antecedents in the fuzzy rule 
base. 

For example if we have a fuzzy inference system of the following form 


premise: Ifa is A; and y is B; then z is C; 
fact: x is A’ andy is B’ 


conclusion z is C’ 
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Fig. 6.6 The input of a fuzzy inference system 


where C’ is determined based on a composition as for example 


C'(z) =(A AB) oR(z,y,2)= \Oo Ae) AB(y) A R(x,y,2) 
cEeX,yEeY 


(for a Mamdani inference) and 


C'(z) = (A’ A B’) 4 R(a, y, z) 


= (Ale) AB) > Riz,y,2) 
wTEX,YyeEY 
(for Gédel inference). 


The fuzzy relation R(x,y,z) is being used here to interpret the fuzzy rule 
base in the premise. 


Example 6.16. To build a fuzzy inference system that solves the room tem- 
perature control problem discussed in the previous sections we can use e.g. a 
Mamdani or Godel inference together with a Mamdani or a Godel rule base. 
In Fig. (G6) the input of the system is represented. 


6.5 The Interpolation Property of a Fuzzy Inference 
System 


A natural property to be required for a fuzzy inference system is the following 
interpolation property (see Fullér ). 
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Fig. 6.8 Output of a Mamdani fuzzy inference system with Gédel rule base 


If the input of the system coincides with the antecedent of a fuzzy rule, 
then the output should coincide with the consequence that corresponds to 
the given antecedent through the fuzzy rule. 

Let us consider first systems based on a single fuzzy rule. We saw that we 
can consider any combination of a fuzzy rule with a fuzzy inference, however 
the combinatorial nature of the problem does not permit an exhaustive anal- 
ysis. So, we will consider some of the typical pairs of fuzzy rules and fuzzy 
inferences. 
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Fig. 6.10 Output of a Gédel fuzzy inference system with Gédel rule base 


Let us start by considering the Mamdani inference with Mamdani rule. 
The system is described by 


BYy) = VV A'@) A Ra, y), Rlw,y) = Ale) A BYy) 
TEX 


The interpolation property says that when the input of the system coincides 
with the antecedent (A’ = A) then the output has to be coincident with 
the consequence (B’ = B), i.e., our fuzzy inference is a generalization of the 
Modus Ponens of classical logic. 
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Proposition 6.17. The Mamdani inference with Mamdani rule 


= \ A(e) AR(a,y), R(x,y) = A(z) A BYy), 
rex 


such that there exists an xo € X with A(ao) = 1, satisfies the interpolation 
property, i.e., if A’ = A, then B’ = B. 


Proof. We have 


By) = \V Ale) \R(@,y) = VV Alo) Bly) 


wExX LEX 


= \ (A(z) A BY) = (Vv — A Bly). 


vex vex 
Since A is normalized we have \/,-. A(z) = 1 and then B’(y) = 1A Bly) = 
Bly). 7 


Remark 6.18. The hypothesis of the previous proposition can be weakened 
from A being normal to V,cx A(x) = Vyex Bly). 


Let us consider the Mamdani inference with Larsen rule. 
Proposition 6.19. The Mamdani inference with Larsen rule 

= VV Aa) AR(a,y), R(x,y) = A(e) - By) 

LEX 
such that there exists an xo € X with A(x) = 1 satisfies the interpolation 
property, t.e., if A! = A then B’ = B. 
Proof. We leave the proof as an exercise to the reader. = 
We can generalize the previous two propositions for an arbitrary t-norm. 
Proposition 6.20. The Mamdani inference with t-norm rule 

= VJ Aa) A R(a,y), R(w,y) = A(w)T By) 

cee, G 


such that there exists an xo € X with A(x) = 1 satisfies the interpolation 
property, i.e., if A’ = A then B’ = B. 


Proof. From the properties of a t-norm we immediately get A(x)TB(y) < 
A(x). We have 
= \V A A(a) A R(x, y) 


cEX 


= VV A(z) A (A(@)TB(y)) = \V A(@)TBYy) 


wEX rex 
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= ( V ato) TB(y) = 1T Bly) = Biy). 


rex 


Let us consider the Mamdani inference with Godel rule 


= VJ A(z) AR(2,y), R(x, y) = A(x) > Bly). 
crEX 


Remark 6.21. We observe here that we can interpret the interpolation prop- 
erty of a Mamdani inference with Godel rule as a fuzzy relational equation. 
Indeed, the interpolation property can be written as AoR = B. This equation, 
by Sanchez Theorem [3.24] has a solution if and only if R(x,y) = A14B 
is a solution, and in this case it is the greatest solution (A(x) = A(1,x), 
B(y) = B(1,y) are interpreted here as row vectors then 


R(z, y) =A'4 Biz, y) 


= \\ Alz,1) > Bi, y) = A(x) > Biy) 
i=1 
becomes the Gédel implication. As a conclusion, the fuzzy relational equation 


is solvable if and only if the inference system with Mamdani inference and 
Godel rule has the interpolation property. 


Proposition 6.22. The Mamdani inference with Godel rule 


=) A'(x) A R(a,y), R(a,y) = A(x) > B(y) 
rex 


such that A is continuous and there exists an x € X such that A(ao) = 1 
fulfills the interpolation property, i.e., if A’ = A then B' = B. 


Proof. We have 
=\V A A(x) A R(a, y) 


cExX 


= \/ Ac ) > Bly)). 
rex 
Let 
Uy = {x € X|A(x) < Bly)}- 
Then we have 


= VV A(z) A (A(z) v VV A(a) x) > B(y)) 


xzeUy x¢Uy 


= VV A(z)Alv VV A(z) A BYy) 


weUy a¢Uy 
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= V A@)v V Bly) = Bly) V BYy) = Biy). 


xeUy xg¢Uy 


We have used here the property that if A is continuous then it attains its 
boundary which is B(y) within U,. a 


Let us consider the Godel inference with Mamdani rule. The system is de- 
scribed by 


=] A'(x) > R(a,y), R(x, y) = A(x) A Bly). 
rEX 


Remark 6.23. We observe here that we can interpret the interpolation prop- 
erty of a Godel inference with Mamdani rule as a fuzzy relational equation 
A<R=B. This equation, by Miyakoshi-Shimbo Theorem|[3.27 has a solution 
if and only if R(x,y) = A~'o B is a solution, and in this case it is the least 
solution and then 


R(x, y) = A~'o B(z,y) = V A(a,1) A B(1,y) = A(z) A B(y) 


becomes the Mamdani rule. As a conclusion, the equation is solvable if and 
only if the inference system with Mamdani inference and Godel rule has the 
interpolation property. 


Proposition 6.24. The Godel inference with Mamdani rule 
= | A(2) > R(a,y), R(a,y) = A(x) A By) 
wExX 


with A © F such that there exists an ap € X such that A(xo) = 1 possesses 
the interpolation property, i.e., if A! = A then B' = B. 


Proof. We have 
= \ Ale) > R(z,y) = A Ale) (x) A B(y)). 


Lex rEeX 
Let Uy = {x € X|A(x) < B(y)}. Then we have 


= \\ Ale) > (A@ABY))A A Ale) > (A(z) A BY) 


xzeUy xg¢Uy 


= \\ A(z) > A(x) A f(\ A(z) > By) 


zeUy «Uy 


=1A A BY) = 


xg¢Uy 
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The infimum /\,¢, B(y) exists since the normality of A implies that X —U, 
is nonempty whenever B(y) < 1. a 


As we have discussed before we can rarely rely on one single fuzzy rule when 
designing a fuzzy inference system, instead, in most of the situations we have 
a rule base. So we will analyze the interpolation property of a fuzzy inference 
system together with a fuzzy rule base. 


Proposition 6.25. Let us consider the Mamdani inference with Mamdani 
rule base 


= A'(x) \ R(a,y), R(x,y) = VV A;(x) A Bi(y) 


cEX i=l 


such that 
(i) for every i =1,...,n there exists an x; € X such that A;(x;) = 1; 
(ii) any two antecedents A;,A;, i #j have disjoint supports 
Then the interpolation property is verified, i.e., if A’ = A; then B’ = B,. 


Proof. We have 


= \ Aj(a JA R(a,y) = VV Aj(2 yaa i(x) A Bi(y) 


LEX cEex 


= VV Aile) A Ail) A Bily) = VB. AV Aj(x) A Ai(a) 


A\ Aja) A Aj(2) = Bj(y). 


cEX 
The fact that A; and A; have disjoint support gives V,-. Aj(x)AAi(x) = di; 
(6;; being Kronecker delta), rT] 
Next we consider the Mamdani inference with Larsen rule base. 


Proposition 6.26. Let us consider the Mamdani inference with Larsen rule 
base 


=i A'(x) \ R(a,y), R(x,y) = VV A;(zx) - Bi(y) 
cEX i=l 


such that 
(i) for every i =1,...,n there exists an x; € X such that A;(x;) = 1; 
(ii) any two antecedents A;,A;, i # Jj have disjoint supports 
Then the interpolation property is verified, i.e., if A’ = A; then B’ = B;. 


Proof. The proof is left as an exercise. | 
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Remark 6.27. The requirement that the antecedents have disjoint support 
in the previous two propositions is too strong. This requirement gives that 
if A’ has its support disjoint from any of the antecedents, the output of the 
fuzzy system is 0. If we do not require a disjoint support then we can prove 
the following result. 


Proposition 6.28. Let us consider the Mamdani inference with Mamdani 
rule base 


n 


= \f A'(x) \ R(a,y), R(x,y) = VV A;(x) A Bi(y) 


wEX i=l 


such that for every i =1,...,n there exists an x; € X such that Aj(a;) = 1. 
Under this condition, if A' = A; then B’ > B,. 


Proof. The proof is left as an exercise. a 


Let us consider now a Mamdani inference with Gédel rule base. The system 
is described by 


n 


= iy A'(x) A R(x, y), R(a,y) = \ Aj(x) + Bi(y). 


cEX i=1 


Remark 6.29. We observe here that we can interpret the interpolation 
property of a Mamdani inference with Godel rule base as a fuzzy relational 
equation. Indeed, the interpolation property can be written as A;o R = Bi, 
i=1,...,n. If Ai(x) = A(i,x), Bi(y) = Bi, y), t= 1,...,n are interpreted as 
fuzzy relations we can rewrite our equation as Ao R= B. This equation has 
a solution if and only if R(x,y) = A~!<B is a solution, and in this case it 
is the greatest solution 


n 


R(z,y) = A714 B(x, y) = /\ A(a,i) + B(i,y) 


As a conclusion, the equation is solvable if and only if the inference system 
with Mamdani inference and Godel rule base has the interpolation property. 


Proposition 6.30. Let us consider a Mamdani inference with Godel rule 


base 
nm 


= \J A (2) AR(z,y), R(x, y) = A Ailx) > Bily). 


cEX i=l 
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(i) If A; are normal and continuous and 

(ii) if the core of any A; and the support of any A; are disjoint wheni Fj, 

then the Mamdani inference with Godel rule base satisfies the interpolation 
property: if A' = A; then B' = B;. 


Proof. We have 


< \V Aj(x) A (Aj (a) > B;(y)) < By(y), 


where the last equality is obtained from the property x A (x > y) < y. Also, 


n 


Bi(y) = \f Aj(x) A /\ Ai(x) > Bily) 


> /\ Aj(@) A (Ai(@) + Bi(y)), VE € X. 


i=1 


We take Z € core(A;) and & ¢ supp(A;) then 


BY(y) 2 Aj(®) A (Aj() > B;(y)) 


A \\ Aj(2) A (Ai(@) > Bi(y)) 


=1A(1> B;(y))A 1A 0 > Bily)) 
tAj 
= By(y) \1 = B;(y). 
Combining the two inequalities leads to the required conclusion. | 
Condition (ii) and continuity are not too strong requirements, however if 


released we still have an inequality. 


Proposition 6.31. Let us consider a Mamdani inference with Godel rule 


base 
nm 


By) = VV A(a) A R@a,y), R(z,y) = /\ Aix) > Bily). 


wExX i=l 


If A; are normal and if A’ = A; then B’ < B;. 
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Proof. We leave the proof to the reader as an exercise. = 


A rule base that has the antecedents fulfilling the property described in this 
theorem is said to be separated. 

Let us consider the Gédel inference with Mamdani rule base. The system 
is described by 


n 


= f\ Aa) > R(w,y), R(w,y) = VV A(z) A Bily). 


LEX i=l 


Remark 6.32. We observe here that we can interpret the interpolation prop- 
erty of a Godel inference with Mamdani rule base as a fuzzy relational equa- 
tion A, dR = B,,i = 1,...,n or considering A(i,x) = Aj(x) and B(i,x) = 
B,(x) we can write AAR = B. This equation, by Miyakoshi-Shimbo theorem 
has a solution if and only if R(x,y) = A~‘o B is a solution, and in this case 
it is the least solution and we also have 


R(a,y) = A710 Baz, y) = VV A(a,7) A B(t, y) 


i=1 


n 
= \V Ai(x) A Bi(y). 
i=1 
becomes the Godel implication. As a conclusion, the equation is solvable if 
and only if the inference system with Mamdani inference and Godel rule base 
has the interpolation property. 


Proposition 6.33. Let us consider the Godel inference with Mamdani rule 


base 
n 


=" A'(x) > R(a,y), R(x, y) = \V Ai(x) A Bily). 
Lex i=1 
(i) If A; are normal and continuous 
(ii) and if the core of any A; and the support of any A; are disjoint when 
iF Jj, 
then the interpolation property holds i.e., if A! = A; then B’ = B;. 
Proof. We have 
=/\ Aj(x) > R(z,y) 


cEX 
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We take Z € core(A;) and & ¢ supp(A;) then 


= (Aj(Z) > A;( vVA )A Bily) 
ixj 
(1+ 1A B,(y)) V \/ 13 0A Bi(y) = By(y) V0 = B;(y). 
ifj 


We can obtain one of the inequalities under very light conditions. 


Proposition 6.34. Let us consider the Godel inference with Mamdani rule 


base 
n 


=/\ A'(x) > R(a,y), R(z,y) = VV Aj(x) A Bi(y). 


wExX i=1 
If A; are normal and if A’ = A; then B’ > B;. 
Proof. The proof is left to the reader. | 


Proposition 6.35. Let us consider the Godel residual inference with Mam- 
dani rule base 


=\ A'(2) +7 R(a,y), R(x,y) = VV A;(x) A B;(y). 


rEX i=1 


(i) If A; are normal and continuous 

(ii) and if the core of any A; and the support of any A; are disjoint when 
tF#j, 

then the interpolation property holds i.e., if A’ = A; then B’ = B;. 


Proof. We leave the proof to the reader as an exercise. a 


6.6 Example of a Fuzzy Inference System 


As an application of a fuzzy inference system we consider a problem of Com- 
puting with Words (see Zadeh [I57]). 

Let us consider a problem with Lt. Columbo. The problem was proposed 
in the paper Dvorak-Novak [54], but with a different solution, not the one 
presented here. The problem’s statement is as follows (see Dvorak-Novak 


[54]): 
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Example 6.36. “Mr. John Smith has been shot dead in his house. He was 
found by his friend, Mr. Carry. Lt. Columbo suspects Mr. Carry to be the 
murderer. 

Mr. Carry’s testimony is the following: I have started from my home at 
about 6:30, arrived to John’s house at about 7, found John dead and went 
immediately to the phone box to call police. They told me to wait and came 
immediately. 

Lt. Columbo has found the following evidence about dead Mr. Smith: He 
had high quality suit with broken wristwatch stopped at 5:45. No evidence of 
strong strike on his body. Lt. Columbo touched engine of Mr. Carry’s car and 
found it to be more or less cold.” 

To be able to analyze the problem we need to understand and implement 
(following the ideas in Dvorak-Novak [o4)) commonsense knowledge. We will 
use fuzzy if then rules for this task. Let us start with describing how engine 
temperature depends on drive duration. 


1. If drive duration is big and time stopped is small then engine is hot. 
2. If drive duration is small then engine is cold. 

3. If time stopped is big then engine is cold. 

Another set of fuzzy rules concerns the wristwatch quality. 

1. If suit quality is high then wristwatch quality is high. 

2. If suit quality is low then wristwatch quality is low. 


The last set of fuzzy rules concerns how likely the wristwatch is broken. 


1. If wristwatch quality is high and strike is unlikely then broken is unlikely. 


Fig. 6.11 Drive duration small (dash), big (dash-dot) and about 30’ from Mr. 
Carry’s testimony (solid line) 
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Fig. 6.12 Time stooped small (dash), big (dash-dot) and the fuzzy set representing 
the fact that police came immediately (solid line) 


T T T , ; 
150 200 


Fig. 6.13 Engine Temperature cold (dash-double dot), hot (dash), more or less 
cold (dash-dot), and the output of the inference system (solid line) 


2. If wristwatch quality is low and strike is likely then broken is likely. 


3. If strike is likely then broken is more or less likely. 


The antecedents for the first set of rules are drive duration with antecedents 
small and big represented in Fig. together with Mr. Carry’s drive dura- 
tion of about 30’ as he started from home at about 6:30 and arrived at John’s 
house at about 7. The time since the car has stopped and cooled down is 
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Fig. 6.14 Watch broken unlikely (dash-dot), more or less likely (dash-double dot) 
likely (dash), and the output fuzzy set obtained by fuzzy inference (solid line) 


represented in Fig. [6.12] The engine temperature is represented in Fig[6.13 
As an input considering Mr. Carry’s drive duration and time stopped we can 
consider a fuzzy inference system to compute the fuzzy sets associated Mr. 
Carry’s testimony and compare it with Lt. Columbo’s observations. We used 
a Mamdani inference and a Mamdani rule base for simplicity but similar re- 
sults are obtained using other inference systems. The output of the inference 
system (solid line in Fig. (6.13) represents the engine temperature inferred 
from Mr. Carry’s testimony and it is compared with the engine temperature 
observed by Lt. Columbo. The result shows that according to Mr. Carry’s 
testimony the engine temperature should be much higher than the one ob- 
served by Lt. Columbo, so Mr. Carry is lying. We have also considered a 
fuzzy inference system to determine how likely the wristwatch was broken at 
the time of John’s death. We will skip some details and we show the output 
of the fuzzy system with Mamdani inference and rule base in Fig. The 
evidence gathered by Lt. Columbo regarding qualitative estimates is used as 
input of a fuzzy inference system consisting of the last two set of fuzzy rules 
and we obtain that it is unlikely that the watch broke at the time of death of 
the victim. Since the watch is broken, this is considered indirect testimony by 
Mr. Carry and it turns out again that it contradicts the evidence, i.e., Mr. 
Carry is lying. 


6.7 Problems 
1. Consider the fuzzy rule 


If a is A then y is B 
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where the fuzzy sets A, B : {1,2,3,4,5} — [0,1] are defined as A(x) = 
O24 OF, 54+ 04 92 By) = $+ 4+ 454+ %. Find the 
Mamdani and Godel fuzzy rules associated to the given fuzzy sets. Write 
the Mamdani and Gédel inference associated to the fuzzy rule. If A’(a) = 
OL, OT 03,0219 find the output of the Mamdani and Gédel inference 
with Mamdani and Gédel rule respectively (each rule can be combined 


with each inference). 


Consider the fuzzy rule 
If « is A then y is B 


where the fuzzy sets A : [0,10] — [0,1] and B : [0,100] — [0,1] are 
triangular numbers defined as A = (3,5,6) B = (10,20,30). Find the 
Mamdani fuzzy rule associated to the given fuzzy sets and then graph it. 
Write the Mamdani inference associated to the fuzzy rule. If A’ = (2,3, 4) 
then calculate the output of the Mamdani inference with Mamdani rule 
and then graph it. 


Consider the fuzzy rule 
If x is A then y is B 


where the fuzzy sets A : [0,10] — [0,1] and B : [0,100] — [0,1] are 
trapezoidal numbers defined as A = (3,5,6,8) B = (10, 20, 30, 40). Find 
the Mamdani fuzzy rule associated to the given fuzzy sets and then graph 
it. Write the Mamdani inference associated to the fuzzy rule. If A’ = x44} 
is a singleton input then find the output of the Mamdani inference with 
Mamdani rule and then graph it. 


Set up a fuzzy rule base and a fuzzy inference system for the problem 
of filling up a reservoir with water. We can consider for example three 
antecedents: water level is low, medium, high) and correspondingly three 
consequences debit is high, medium, low. Give the fuzzy if then rules, 
the antecedents and the consequences and explain what fuzzy rule base 
and inference you would use with them. 


Set up a fuzzy inference system for an agent in a video-game that has to 
avoid the enemy. The antecedents that can be considered have to take 
into account that the enemy can be near or far form our agent and the 
enemy may be approaching, stationary or departing. The agent we are 
considering may be stationary, or moving away slow, moving away fast 
(from the enemy). Give the fuzzy if then rules, the antecedents and the 
consequences and explain what fuzzy rule base and inference you would 
use with them. 


10. 


11. 
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. Set up a fuzzy inference system which has to decide on the tip at a 


restaurant depending on the quality of service and the quality of food. 
Write a set of fuzzy rules with antecedents and consequences, and a 
fuzzy inference. Consider a set of premises and find the corresponding 
conclusion. 


. Let us consider the Mamdani inference with Larsen rule. The system is 


described by 
= \ Aa) A R(a,y), R(w,y) = A(z) - Bly) 
TEX 


Prove that if A is normal then the system has the interpolation property, 
ie. if A’ = A then B’ = B. 


. Let us consider the Mamdani inference with Larsen rule base. The system 


is described by 
= \J A(2)AR(a,y), R(a,y) = \V Ai(x) - Bily) 
LEX i=1 


Prove that if A; are normal and if they have disjoint supports, then the 
system has the interpolation property, i-e. if A’ = A; then B’ = B;. 


. Let us consider the Mamdani inference with t-norm rule base 


n 


=\ A'(xz) A R(x, y), R(x,y) = VV A;(x)TBi(y) 


cTEX i=1 


such that for every i = 1,...,n there exists an x; € X such that A;(x;) = 
1. Prove that the following property is verified: If A’ = A; then B’ > B; 


Let us consider a Mamdani inference with Gédel rule base 


n 


=\/ A'(x) A R(x, y), R(a,y) = \ Aj(x) > Bi(y). 


rex i=1 
if A; are normal and if A’ = A; then B’ < B;. 


Let us consider the Gédel residual inference with Mamdani rule base 
n 


= \\ A(z) 7 R@a,y), R(w,y) = VV Aila) A Bily). 


cEX i=l 


(i) If A; are normal and continuous 

(ii) and if the core of any A; and the support of any A; are disjoint when 
i #5, 

then the interpolation property holds i.e., if A’ = A; then B’ = B;. 


7 
Single Input Single Output 
Fuzzy Systems 


In the previous chapter we have described in detail Fuzzy Inference Systems. 
These have fuzzy sets as inputs, and their output is a fuzzy set as well, so these 
systems work exclusively in a fuzzy setting. Often, in practical applications 
we need to be able to accept crisp inputs and also, the system needs to 
produce a crisp number for the output. Surely this is often a well defined 
classical functional relationship between inputs and outputs. Naturally raises 
the question why do we need fuzzy systems when we have a crisp relationship, 
crisp input and also a crisp output for a classical system. The reason for 
this fact lies in epistemic uncertainty. However we have a crisp relationship, 
this is often unknown or only partially known to us. As we will see in this 
chapter fuzzy systems can fill in the gaps and approximate any desired output 
with arbitrary precision. Approximation properties of fuzzy systems were 
widely investigated in the literature starting from B. Kosko’s paper [97]. Since 
then many authors dealt with approximation properties of fuzzy systems 
Kosko [III], Li-Shi-Li [100], Li-Shi-Li Tikk-Kéczy-Gedeon [146], Kéczy- 
Zorat [95]. Yet a fully constructive method providing also an error estimate is 
still missing. The approach in Li-Shi-Li [100], Li-Shi-Li [101] is constructive 
but not fully constructive, because it requires the knowledge of the inverse 
image of the function to be approximated. The present approach solves this 
problem. The difficulty in studying such systems is in the fact that they 
are nonlinear operators, based on max, min and — type operations. Tools 
to deal with similar problems were recently developed in Bede-Nobuhara- 
Dankova-Di Nola [22] and Bede-Coroianu-Gal [16]. The results in Section [Z.3] 
are published for the first time in the present work. 
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Besides Mamdani approach (Mamdani Assilian [107]) there is another ma- 
jor direction, that of Takagi-Sugeno fuzzy systems (Sugeno ). Sugeno sys- 
tems and their approximation capability were studied in Buckley [33], Ying 
[153], Celikyilmaz-Tiirksen [34], Sonbol-Fadali etc. Again the construc- 
tive results are either missing from the literature or they are not accompa- 
nied by error estimates. In Section 7.5 we prove approximation properties for 
Takagi-Sugeno fuzzy systems and higher order Takagi-Sugeno fuzzy systems 
(see Celikyilmaz-Tiirksen [34]). The results of Section [Z4]are new, published 
in the present work for the first time. The error estimates presented here are 
simple and they open up new research directions and applications. 

Combining these approximation properties of a fuzzy system with the abil- 
ity to model linguistic expressions makes them very interesting to study and 
also very efficient in applications. This motivates us to emphasize the idea 
that the topic of Fuzzy Sets and Fuzzy Systems is an independent disci- 
pline within Mathematics, being a unique combination of ideas overlapping 
strongly with topics in Logic and Approximation Theory. 


7.1 Structure of a SISO Fuzzy System 


A single input single output fuzzy system (SISO Fuzzy System) uses 
a crisp input, fuzzifies it, maps it through a fuzzy inference system and the 
fuzzy output that is obtained is transformed into a crisp output. Often SISO 
Fuzzy Systems are used in a control problem and then they are called fuzzy 
controllers. 

The diagram of a SISO fuzzy system is represented in Fig. [71] 


[Crisp input | —. [Fuzzifier] ——, [Inference system | —, [Defuzzifier] —, [Crisp output 


: 


Fig. 7.1 The components of a fuzzy controller 


Let us discuss in what follows each of the components. 


7.1.1 Fuzztfication 


Most of the systems use the most basic fuzzifier that is the canonical inclusion. 
If ro € X is acrisp input then the fuzzy set associated with it is the singleton 
fuzzy set x9, given by the characteristic function 


1 if r=29 


ANG) =XeH(2) = { 0 if rA#29 
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Fuzzy Systems can take into account uncertainty at this step. If the input 
crisp value is influenced by uncertainties then these can be taken into account 
when building a non-singleton fuzzy input. In the present chapter we consider 
the inclusion fuzzifier. 


7.1.2 Fuzzy Rule Base 


The fuzzy rule base can be described as a fuzzy relation R(x, y). For a fuzzy 
controller we can select among different types of fuzzy rule bases as described 
previously. 


7.1.3 Fuzzy Inference 


The fuzzy inference system that we consider can be of any type that have 
been discussed before (Mamdani, Gédel, Larsen etc.). Mamdani Inference 
gives 
By) = (Ro A(x) = \f A(x) A R(z,y), 
cEX 


where the fuzzy relation R is the fuzzy rule base. 


7.1.4 Defuzztfication 


Defuzzification is the final step in a fuzzy control algorithm. Based on the 
output of a fuzzy controller one has to give an estimate of the crisp quan- 
tity (a representative crisp element) for the output value of the SISO fuzzy 
system. In this case one has to use a defuzzification. There are many differ- 
ent defuzzification methods and based on the given application that we are 
working on, we can select a suitable defuzzification. 


Center of Gravity (COG). The value selected is the center of gravity of 
the fuzzy set u € F(X). More formally, we have 


Swe: ula)dz 

fvu@de 
where W = supp(u). In the present work the Center of Gravity defuzzification 
is the most frequently used. 


Center of Area (COA). If u € F(R) then the number COA(u) is defined 
as the point of the support of u that divides the area under the membership 
function into two equal parts. If COA(u) = a then a satisfies 


[wear = [ w(oyae. 


COG(u) = 
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Expected value and expected interval (EV and EVI). If u is a con- 
tinuous fuzzy number then the expected value EV(u) is given by 


1 
EV(u) = sf (uz + ui) dr. 


and the expected interval is 


1 1 
EVI(u) = if urdr, [ utdr| , 
0 0 


The expected value is the midpoint of the expected interval. 


Mean of Maxima (MOM). The mean of maxima defuzzifier selects the 
mean value of the points where the membership grade attains its maximum. 


fay ede 
eeu dx 


where U = {x € X|u(x) = maxtex u(t)}. 


MOM (u) = 


Maximum criterion. Sometimes, to avoid practical difficulties the choice 
of the defuzzification can be arbitrary fulfilling the max criterion i.e., we may 
select arbitrary x € U with 


U={x€ X|u(x) = max u(t) }. 


7.2 Fuzzy Inference and Rule Base for a SISO Fuzzy 
System 


Mamdani inference has simple expression on par with great computational 
and intuitive properties. Also, these were historically the systems used in the 
first fuzzy controllers. Using a Godel inference has apparently some theoret- 
ical advantages over Mamdani inference because of their interpretation via 
fuzzy relational equations. The choice of Mamdani inference in SISO fuzzy 
systems is motivated by the following property. 


Proposition 7.1. If A’(x) = xX{2.}(x) ts a crisp input of a fuzzy inference 
system with a given rule base R(x,y), then the outputs of Mamdani, Larsen, 
t-norm, Godel and Godel residual inference systems coincide. 


Proof. Let 


F _ jf 1 if r=29 
Ata)={ 4 if «#2 


Then for the Mamdani inference we have 


BY(y) = \f A'(@) A R@a,y) = A'(x0) A R(x0,9) 
LEX 
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=1A R(xo, y) = R(xo,y)- 
For Larsen inference we have 


= \ Ae): R(a,y) 


wExX 


= A'(x9) - R(ao,y) = R(20,y). 


Then for the t-norm based inference we have 


= \VV A(a)TR(a,y) = A’(x0)TR(20,9) 
LEX 


= 1TR(x0,y) = R20, y). 


For the Godel inference we have 


= [VV AG) )> R(z,y) 


cEX 


=1A A'(ao) > R(a0,y) 
=1-—> R(x, y) = R(20, y). 


For the Godel residual inference we have 


= \ Ae) >r Ra,y) 


cEX 


=1AA'(ao) +r R(x0,y) 


= —7T R(x, y) _ R(xo,y)- 
& 


Similar result holds for the more general case of having more antecedents. 
In a SISO fuzzy system the inference system used does not have an impact 
on the output of the fuzzy system, so the output is determined solely by the 
rule base used. The rule base that we are using can still be chosen to be of 
Mamdani, Larsen, t-norm, Gédel or Gédel residual type. Since the inference 
system in the SISO case does not matter, the fuzzy rule base is the one that 
will be specified and it will decide the output of the system. 

The following results show a simplification for the calculations of the out- 
put of a SISO fuzzy system and so, these systems will be computationally 
very inexpensive, making them widely applicable in real-time situations. 
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Proposition 7.2. If A’(x) = xX{2.}(x) is a crisp input of a fuzzy inference 
system with a Mamdani rule base 


n 


R(x,y) = \f Ail) A Bily) 


i=1 


then the output of the system can be calculated as 
By) = Ay. ai \ Bi(y), 
i=1 


where a; = A;(xo) is the firing strength of the i*” fuzzy rule. 
Proof. Let 


i jf 1 if t=29 
Aa) ={ 4 if cA#2Xp 


Then we have 


where a; = Aj(z0). | 
Similar results hold for the Larsen and t-norm based inferences. 
Proposition 7.3. If A’(x) is a crisp input of a fuzzy inference system with 


a Larsen rule base 
nm 


then 


where a; = A;(xq) is the firing strength of the i*” fuzzy rule. 


Proof. The proof is left as an exercise. a 
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Proposition 7.4. If A’(x) is a crisp input of a fuzzy inference system with 


a t-norm rule base 
n 


R(w,y) = \J Ai(x)TBi(y) 


i=1 


= \V aT Bi(y) 
i=l 


where a; = A;(xo) is the firing strength of the i*” fuzzy rule. 
Proof. Let 


then 


Then we have 


with a; = A;(z0). | 


Proposition 7.5. If A’(x) is a crisp input of a fuzzy inference system with 


a Godel rule base . 


R(x,y) = \ Ai(z) > Bily) 


i=1 


= \ a> Bily) 
t=1 


where a; = A;(xo) is the firing strength of the i*” fuzzy rule. 
Proof. Let 


then 


Then we have 


where a; = A;(z0). r 
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Proposition 7.6. If A’(x) is a crisp input of a fuzzy inference system with 
a residual Godel rule base 


n 


R(x,y) = [\ Ail) > Bily) 


i=l 
then h 
By) = ar Bily), 


i=1 
where a; = A;(xo) is the firing strength of the i*” fuzzy rule. 
Proof. The proof is left as an exercise. = 


These properties suggest a simplified implementation of a SISO fuzzy system, 
when the input of the system is crisp. 


Algorithm 7.7. 1. Input the crisp value x. 
2. Calculate the firing strengths of each fuzzy rule: a; = Aj;(xo). 
8. Calculate for a given y € Y the output fuzzy set that is 


By) = V ai \ Bi(y) 


for a Mamdani rule base. 
4. Defuzzify B’ (yo = defuzz(B’).) 
5. Output yo. 


Example 7.8. Let us consider a simple Mamdani SISO fuzzy system with 
two fuzzy rules 
If x is A; then y is B;,i = 1,2, 
with Ay = (1,2,3), Ae = (2,3,4), Bi = (2,4,6), Bo = (4,6,8). Let xo = 2.25. 
Then the firing strength of the first rule is 0.75 while the firing strength of 
the second rule is 0.25. Then the output of the system is 
B'(y) = (0.75 A Bi(y)) V (0.25 A Ba(y)). 


The output can be expressed as 


uo? if 2<y<35 
0.75 if 35<y<4.5 
B'(y) = ou if 45<y<55 
0.25 if 55<y<7.5 
Sv if T5<y<8 
0 otherwise 


Now we have to defuzzify this result. We have His B'(y)-y- dy = 10.875, 
{> B'(y) «dy = 2.375 and COG(B’) = 4.579. 
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Remark 7.9. If the fuzzy rule base has more than one antecedent, similar 
conclusions hold true. Indeed, if e.g. 


n 


R(x, y,2) = \f Ai(w) A Bi(y) A Ci(z) 


i=1 


is a Mamdani rule base in a Mamdani inference with crisp input (20, yo), 
then similar to the previous results we have 


n 


C'(z)= V/ Ai(x0) A Bi(yo) A Ci(z) 


v 


where the firing strength of the i*” rule is 


a= Aj(Xo) \ Bi(yo). 


7.3 Approximation Properties of SISO Fuzzy Systems 


Let us consider the problem of approximating an unknown continuous func- 
tion f : [a,b] > [c,d], with [c,d] C R by a SISO Fuzzy System. We consider 
[c, d] to be the range of the function f, i.e., f([a, 6]) = [c,d]. The problem has 
been solved for the first time in B. Kosko’s works (see [97]). There were sev- 
eral results, most of them showing that under some conditions, fuzzy systems 
are able to approximate any continuous function with arbitrary accuracy. In 
the approach presented here, the proofs of the approximation properties are 
constructive and error estimates are also provided. This approach is published 
in the present work for the first time. 

Let a= 29 < 4 <<... <n < @n41 = 5 be a partition of the input domain 
with norm 

6= sup {2 _ xii}. 
i=1,....n41 

Let f(vi) = yi,t = 0,...,2 +1 be sample values of the function. Let us 
construct a SISO fuzzy system that describes the functional relationship 
f(x) =y, x € [a, B). 

We consider fuzzy systems with the support of each fuzzy set in the an- 
tecedent part, satisfying A;(x;) = 1 and 


(Ai)o = [ei-1, Gi41],2 = 1,..., 0. 


Additionally we consider A;(x) to be continuous. The fuzzy set A; can be 
seen as a model for the expression x is about 7;, 7 = 1,...,n. 
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The consequence part B; will be considered integrable and it is constructed 
such that B;(y;) = 1 and it has the support 


(Bi)o = [min{yi—1, yi, yi+1},max{yi-1, Yi, Yiti}],¢ = 1,...,n. 
The fuzzy set B; can be seen as a model for the expression y is about y;, 


GHAR ds: 
The fuzzy rule base in this case becomes 


If x is about x; then y is about y;,2 = 1,...,n 
or 
If a is A; then y is B;,i =1,...,n, 


rule which is consistent with our intuitive idea on function approximation. 


7.3.1 Approximation by Mamdani, Larsen and 
t-Norm Based SISO Fuzzy Systems 


Now we consider a SISO fuzzy system with Mamdani rule base and Center 
of Gravity defuzzification. Let x € [a,b] be a crisp input. The fuzzy output 


is calculated as 
n 


B'(y) = \f Ai(x) A Bi(y), 


i=1 


which is subject to defuzzification and the result is 


_ LBW) yy 
JE Bi y)dy 


Combining these two relations we can write a SISO fuzzy system as 


_ Je Via (Ai) A By) 9 dy 
ihe Vin (Ai(x) A Bily)) - dy 


Since A; is continuous, and B; integrable, 7 = 1,...,n we have F(f,x) well 
defined and continuous. 

Usually, the error estimates in classical approximation theory are provided 
in terms of the modulus of continuity (see appendix). 

We will need two lemmas. 


COG(B’) 


F(f,«) 


Lemma 7.10. (see e.g. Bede-Nobuhara-Dankova-Di Nola)For any ai,b; € 
[(0, co), 7 € {0,...,n} we have 


n n 
Va — Voi 
1=0 i=0 


n 
< \VV lai — bil. 
i=0 


7.3 Approximation Properties of SISO Fuzzy Systems 115 
Proof. Since max operation is non-decreasing in its arguments, we have 
n n n 
Vai = \/ [bi +a; — bi] < \ bi + la; — b;| 
i=0 i=0 i=0 
and it follows 


n n n 
i=0 i=0 i=0 


This inequality together with the symmetric case implies the statement of 
the lemma. a 


Remark 7.11. Jf A;,i=1,...,n are continuous and B;,i =1,...,n are inte- 
grable functions then taking into account that the max and min are continu- 
ous bi-variate functions, we obtain that the function F(f,-) : [a,b] > [c,d] is 
continuous, being a composition of continuous functions. If we consider the 
operator F(-,x) : Cla, b] > Cla, b] we observe that it is a nonlinear operator, 
so approximation by F(f,x) can be studied in the framework of nonlinear 
approximation. 


The following approximation theorem can be obtained. 


Theorem 7.12. (Approximation property of the Mamdani SISO fuzzy sys- 
tem) Any continuous function f : [a,b] > R can be uniformly approximated 
by a Mamdani SISO fuzzy system 


dy yn 
’ o- d n = 
Je Vier (Ai(z) A Bi(y)) - dy 
with any membership functions for the antecedents and consequences Aj, 
B,,1=1,...,n satisfying 


(i) A; continuous with (Aj)o = [ti-1, Gigi], = 1,...,75 
(ii) B; integrable with 


(Bi)o = [min{y—1, ys, Yirr$, max{yi-1, Yi, Yet f] 


fori =1,...,n, where y; = f(xi), 1 =0,..,n +1. 
Moreover the following error estimate holds true 


IF (f, ©) — f(a)|| S$ 384 (f,4), 


with 6 = maxj=1,....n{®j — 2-1}. 


Proof. We observe that 


fo Vtg Ai(z) A Bily)] - f(a) dy 


a = f e 
SEVER (Aila) A Bily)) «dy o 
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and we have 

SoM (Ai(a) A Bi(y))] - (y — F(x) « dy 
[OV 24 (Ai(2) A Bily)) + dy 

JEM Pa (Ai) A Buy) y= F@)l dy 
[OV (Ail2) A Bily)) + dy 


F(f,2) — f(a)| = 


< 
By Lemma|[?.10] we have 
JEM Pa (Ad(e) A Bily))] ly = F@) dy 
[OVn (Aula) A Bi(y)) «dy 


The membership degrees A;(a) are null outside of their support. Also, any 
fixed value of x € [a,b] belongs to the support of at most two fuzzy sets A;. 
Suppose that xz € (A;)o U(A;+1)o. Then we have 


IF (f, x) — f(a)| 
2 Jel(Aj(e) A By(y)) V (Ajva(@) A Byva(y))] ly = F@)I dy 


d 
Jc (Ag (@) A By(y)) V (Ajai (@) A By+i(y))] - dy 
Taking now into account that 


IF (f,2) — f(#)| < 


(Bi)o = [min{yi-1, yi, yiti}, max{yi-1, Yi, Yi+1 fl 
we can restrict the integrals to the union of the supports of B; and Bj+1, 
which is a subset of 
[min{yj—1, Yj, Yjt1> Yj+2t>Max{Yj—1, Yj, Yj+1s Yj+2sl- 
We obtain 
IF (f, x) — f(x)| 

« LeaovtaiaolAs(@) A BiD) ¥ (Apta(e) A Byer] ly F@)L ay 

Tee yue,l@ABW)V Aa @)ABaw)l ay 


By the definition of B;, Bj41, and by the intermediate value theorem applied 
to the continuous function f, given y € (B;)o U (Bj41)o there exist z € 
[xj;-1, 2 ;42] such that f(z) = y. Then using the properties of the modulus of 
continuity in Theorem [A.39] we get 


ly — F(@)| = |F(2) — F(a)| S$ © (Ff, |eg42 — 2-11) 
<w(f,3d) < 3w(f, 6), 


n{ Xi — ;-1}. Finally we obtain 


|F(f, x) — f(@)| < 3w(f, 6). 


with 6 = maxj;=1,..., 
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Corollary 7.13. A Mamdani SISO fuzzy system F(f,x) is able to approzi- 
mate any continuous function f(x) with arbitrary accuracy. 


Proof. From Theorem [A.39] we have If 6 > 0 then F(f,2) > f(x) and the 
result is immediate. = 


Corollary 7.14. If we consider f : [0,1] > [c,d] a continuous function and 
the partition a = 4p < @1 <<... < Un41 = b with equally spaced knots, then 
we have 


1 
Fa) - fal ¢30($—5). 
Proof. From Theorem [f.12] the result is immediate. | 


Remark 7.15. We observe that the fuzzy sets A;, B; do not need to be nor- 
mal. A small support ensures the convergence of a fuzzy system to the target 
function. Also, we can consider fuzzy systems with more than two overlap- 
ping supports at a time. For example if (A;)o,(Aj+41)o,---,(Aj+r)o overlap 
and likewise (B;)o,(Bj+1)o,---,(Byj+r)o, then one can obtain the error esti- 
mate 
|F(f, 2) — f(a)ll < (r+ 1)w (Ff, 6) 
in a similar way to Theorem [7.12 


The preceding Theorem can be extended to Mamdani Fuzzy systems with 
Larsen rule base. In fact one can extend the Theorem to any t-norm. 


Theorem 7.16. (Approximation property of the Larsen SISO fuzzy system) 
Any continuous function f : [a,b] > R can be uniformly approximated by a 
Mamdani SISO fuzzy system with Larsen rule base 


JON Ail) - Bi(y)] -y = dy 
SEN, Ail) « Bi(y)] - dy 


with any membership functions for the antecedents and consequences Aj, 
B;,1=1,...,n satisfying 
(i) A; continuous, (Ai)o = [ei-1, ®i41], 7 = 1,. 
(ii) B; integrable, 


F(f,z) = 


ong TU} 


(Bio = [min{y:-1, ys, yer}, max{ys—1, Ys, Yi, 


Yi= f (zi), ‘= 1, song Qe 
Moreover the following error estimate holds true 


with 6 = Max;j=1,..., ni Di = x41}. 


Proof. The proof is left as an exercise. | 


118 7 Single Input Single Output Fuzzy Systems 


Corollary 7.17. A Larsen SISO fuzzy system F(f,x) is able to approximate 
any continuous function f(x) with arbitrary accuracy. 


Proof. The proof is immediate. a 


Theorem 7.18. (Approximation property of the t-norm based SISO fuzzy 
system) Any continuous function f : [a,b] + R can be uniformly approxi- 
mated by a Mamdani SISO fuzzy system with t-norm (we consider a contin- 
uous t-norm T) rule base 


SEV Ai(a)TBi(y)] - y- dy 
[ON%, Ai(@)TBi(y)] - dy 


with any membership functions for the antecedents and consequences Aj, 
B,,t=1,...,n satisfying 

(i) A; continuous, (Ai)o = [@i-1, igi], 7= 1,...,n5 

(ii) B; integrable, 


F(f, 2) _ 


(Bi)o = [min{y:—1, yi, Yr}, Max{yi1, Yi, Yirr }, 


yi = f(a), t= 1,...,0n. 
Moreover the following error estimate holds true 


IF (f, ©) — f(a)|| S$ 384 (f,4), 


with 6 = Maxi. n{ ei — Pier}. 


Proof. The proof is left as an exercise for the reader. a 


7.3.2 Approximation by SISO Fuzzy System of Gédel 
and Godel Residual Types 


Similar to the Mamdani case we consider a continuous function f : [a,b] > 
[c,d], and a = 2% < a1 <<... < pn < Lnqi = 0 be a partition of the input 
domain with norm 


Let f(ai) = yi,t = 0,...,2 +1 be known values of the function. The an- 
tecedents satisfy A;(a;) = 1 and 


(Ai)o = [ei-1, Gi41],7 = 1,..., 0. 


Additionally we consider A; to be continuous. 
The consequences B; are such that B;(y;) = 1 and 


(Bi)o = [min{yi—1, Ys, Yt}, max{yi—1, Ys, Yeti f],t = 1,...,Nn. 
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and they are supposed to be integrable. Now we consider a SISO fuzzy system 
with Gédel rule base and Center of Gravity defuzzification. Let x € [a,b] be 
a crisp input. The fuzzy output is calculated as 


n 


B'(y) = f\ Ai(x) > Bily), 


i=1 
which is subject to defuzzification and the result is 


dp 
COG(B’) = Je Bly) yay, 
J. Bi(y)dy 


The continuity of A; and the integrability of B; ensures the integrability 
of B’. 
Combining these two relations we can write a SISO fuzzy system as 


JE [Near Ail) + Bi(y)] -y-dy 
SON Aix) + Bi(y)] - dy 


Let us remark here that the implication —- is not continuous as a bi-variate 
function but since B; are integrable the output F(f,x) is well defined. In 
general we cannot conclude that F(f,2) is continuous. 

We will need the following Lemma. 


F(f,z) = 


Lemma 7.19. For any a; € [0,00), i € {0,...,n} and y, z € [0,00) we have 


n n n 
ay Jae} < Aai-ly- 2k 


Proof. We observe that 


n n n 
\ay = \ailz +y-—z)< Maile +|y — 2|) 
i=0 i=0 


i=0 


n nm 
< \aiz + \aily —2| 
i=0 i=0 
and symmetrically 
n n n 
\aiz < \ay + \aily — 2. 
i=0 i=0 i=0 


The required inequality follows by combining the two cases. a 
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Remark 7.20. A result similar to Lemma does not hold. In fact, the 
following inequality can be proved 


n n 
— Ao < \/ lai — bil, 
i=0 i=0 


but this inequality cannot be used in the approximation result we are about to 
prove. This inconvenience was resolved by Lemma 


Theorem 7.21. (Approximation property of the Gédel SISO fuzzy system) 
Any continuous function f : [a,b] > R can be uniformly approximated by a 
Godel SISO fuzzy system 


SON A(x) + Bily)] «y+ dy 
So [Nt Ai(2) > Biy)] - dy 


with any membership functions for the antecedents and consequences Aj, 
B,,t=1,...,n satisfying 

(i) A; continuous (Ai)o = [ti-1, Tiga], t= 1,...,0; 

(ii) B; are integrable 


F(f,2) = 


(Bi)o = [min{y—1, ys, Yer}, max{yi_1, Yi, Yitr}] 


fori =1,...,n, where y; = f(a), 1 =0,..,n +1. 
Moreover the following error estimate holds true 


with é = max;=1 ni Di = xi_-1}. 


Poor 


Proof. We observe that 


JIN, Ai(a) > Bi(y)] - f(a) «dy 
SOIAR, Ai(x) > Bi(y)] dy 


and we have 


SONNE A(x) > Bi(y)]- (y -— f(x) dy 
F(f,z) -— f(x)| < —+—-4vasSsoooosVs 
a= SO (AR, Ailx) > Bi(y)] - dy 


By Lemma [7.19] we obtain 
[2 [Nini Ail) + Bi(y)] ly = F@) dy 
SO INL Ai(z) > Bi(y)] - dy 


The membership degrees A;(x) are null outside of their support so the im- 
plication A;(#) — B;(y) = 1 whenever a ¢ (Aj). Also, any fixed value of 


IF (f,2) — f(@)| < 
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x € [a,b] belongs to the support of at most two fuzzy sets A;. Suppose that 
x € (A;)o U (Aj+1)o, then we have 


IF (f, x) — f(a)| 


Z JM Ag(@) + By(y)) A (Ava (@) + Bia y))] ly = F@)| dy 
JEM(Aj(2) > By(y)) A (Ajsa(@) > Byra(y))] - dy 
Taking now into account that 
(Bi)o = [min{y—1, ys, vi41},Max{yi—1, Ye, Yi+r}] 


we can restrict the integrals to the union of the supports of B; and Bj41, 
and by the intermediate value theorem given y € (B;)o U (Bj+41)o there exist 
z € [wj-1,%;+2] such that f(z) = y. Then using Theorem[A.39] we obtain 


ly — f(x)| < 3w(f, 6) 


n{ Xi — U;-1}. Finally we obtain 


|F(f, x) — f(@)| S 3w (fF, 6). 


with 6 = max;—) 


youny 


Corollary 7.22. A Gédel SISO fuzzy system F(f,x) is able to approximate 
any continuous function f(x) with arbitrary accuracy. 


Proof. The proof is immediate. a 
For a residual rule based system we obtain the following property. 


Theorem 7.23. (Approximation property of the residual SISO fuzzy system) 
Any continuous function f : [a,b] > R can be uniformly approximated by a 
Godel residual SISO fuzzy system 


JOIN, Ai(2) Sr Bily)|-y- dy 
[CIN Ail) +7 Bily)] dy 


with any membership functions for the antecedents and consequences A;, Bi, 
i=1,...,n satisfying 

(i) A; are continuous and (A;)o = [%i-1, Ci41], 7 =1,...,05 

(ii) B; are integrable with 


BF e) = 


(Bi)o = [min{yi—1, yi, Yirr$, max{yi-1, Yi, Yt f] 


fori =1,...,n, where y; = f(a), 1 =0,..,n4+1. 
Moreover the following error estimate holds true 


with é = Maxj=1,..., ni Di = xii}. 
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Fig. 7.2 Approximation by Mamdani Fuzzy System. The function f(x) (dashed) 
is approximated by Mamdani SISO fuzzy system with triangular (dash-dot) and 
Gaussian (solid line) membership functions. 


Fig. 7.3 Approximation by Larsen Fuzzy System. The function f(a) (dashed) is ap- 
proximated by Larsen SISO fuzzy system with triangular (dash-dot) and Gaussian 
(solid line) membership functions. 


Proof. The proof is left as an exercise. a 


Corollary 7.24. A residual SISO fuzzy system F(f,x) is able to approximate 
any continuous function f(x) with arbitrary accuracy. 


Proof. The proof is immediate. | 
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Fig. 7.4 Approximation by Gédel Fuzzy System. The function f(a) (dashed) is 
approximated by Gédel SISO fuzzy system with triangular (dash-dot) and Gaussian 
(solid line) membership functions. 


Example 7.25. We consider the function f : [0,2] — R, f(#) = 2a + 
sin 10a. The function is approximated by Mamdani (Fig. [7.2) Larsen (Fig. 
and Gédel (Fig.[74) SISO fuzzy systems. The membership functions of 
antecedents and consequences are of triangular and Gaussian types and there 
are 20 fuzzy rules describing each system. 


7.4 Takagi-Sugeno Fuzzy System 


Takagi-Sugeno fuzzy systems (Sugeno [138]) are intrinsically single input 
single output systems. A Takagi-Sugeno system has the rule base consisting 
of antecedents of linguistic type and conclusions that are piecewise linear 
crisp outputs. This makes the defuzzification step redundant. 


premise: If xis A; then z; =ajx+b;, i=1,...,n 


fact: x is x 
conclusion: z is Zo. 


Takagi-Sugeno (TS) fuzzy controllers do not use an inference system as the 
Mamdani or Godel type systems described in the previous section, instead 
they use the firing strength of each fuzzy rule in the computation of the con- 
clusions. TS fuzzy controller has crisp inputs, singleton fuzzifier and practi- 
cally it does not have a defuzzifier. 

The control algorithm for a TS fuzzy system is as follows: 
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Algorithm 7.26. 1. Input the crisp value xo. 
2. Calculate the firing strengths of each fuzzy rule: 


ay= Aj(20). 


8. Calculate the individual rule outputs 


Zi = AjXo + Yj. 


4. Aggregate the individual rule outputs and the system’s output is 


A Takagi-Sugeno system with more antecedents can be described as follows: 


premise: if x is A; and y is B; then z; = ajax + biyt+o, 1=1,...,n 


fact: x is x and y is yo 


conclusion : z is zo 


The control algorithm for a TS fuzzy system of this type is modified as follows 


Algorithm 7.27. 1. Input the crisp values x9, yo. 
2. Calculate the firing strengths of each fuzzy rule 
a; = A;(xo0) A Bi(yo). 
3. Calculate the rule outputs 
2, = ax + biyo + G.- 


4. The output is 


Dies 2 


aan a 


Remark 7.28. Designing the rule base for a TS fuzzy system requires knowl- 
edge of the parameters a;,bj,c;, 1 = 1,...,n. The values of the parameters 
a;,b; and c; can be given in advance or they can be obtained using adaptive 
techniques that will be discussed later. 


zZ0 = 
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Example 7.29. Consider the following TS fuzzy system 


if x is big and y is small then z1 =a+y 


if x is medium and y is big then zg = 2x — y. 


Consider the crisp inputs 9 = 3 and yo = 2. Also, we know that ppig(3) = 


0.8, HJsmatt (2) = 0.2, Lbmedium (3) - 0.6, Hig (2) = 0.9. 
We can compute the firing strength of the rules 


a, =0.8A 0.2 = 0.2, ag =0.6A 0.9 = 0.6 
The rule outputs are 
21 =Zo+Yo =5, 22 = 2%) — yo =4 


and the output of the system is 


_ 0.2-5+0.6-4 


= = 4.25, 
=“ 0240.6 


7.5 Approximation Properties of Takagi-Sugeno Fuzzy 
Systems 


Let us consider the problem of approximating an unknown continuous func- 
tion f : [a,b] > [c,d], with [c,d] C R by a Takagi-Sugeno Fuzzy System. In 
the present section we adapt a constructive approach. Let a = x < x < 
we S Bn < Ln41 = b be a partition of the input domain and let f(x;) = yi, 
i =1,...,n, be sample data. Let A; € F([a,b]),7 =1,...,n be fuzzy sets with 
continuous membership degree such that (A;)o = [2i-1, 2:41]. The output of 
the Takagi-Sugeno fuzzy System can be written as 


i nec 


with a;,b; € R. 
Also, it is possible to generalize a TS fuzzy system such that the individual 
rule outputs are polynomials. 


_ Dany Aj(x) . (Gm 40 + Oe age ase ate a,i) 


Dai Ai(2) , 


This combination builds a higher-order Takagi-Sugeno fuzzy system. The 
idea to consider combinations between different approximation operators is 
not new, it was used before in several works in Approximation Theory see 
Gal |67], open problem 1.6.11. Also in the same direction see e.g. Lucyna 


F(f, 2) 
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102], where the authors combine approximation operators of Favard type 
with Taylor series and Coman , for a Shepard-Taylor combined operator 
(see also Stancu-Coman-Blaga [134]). These ideas can be used successfully 
to prove that Takagi-Sugeno fuzzy systems have very good approximation 
properties. 

In a Takagi-Sugeno fuzzy system the coefficients a;,b;,i = 1,..,n (for the 
linear individual rule output) and respectively a,;,i = 1,...,n,k = 0,...,m 
(for higher order Takagi-Sugeno system) are obtained through an optimiza- 
tion process. 

We adopt a constructive approach here. Surely, starting with the values 
that we select further optimization is still possible. 


Theorem 7.30. (Approzimation property of Takagi-Sugeno fuzzy system) 
Any continuously differentiable function f : [a,b] > R can be uniformly ap- 
proximated by a Takagi-Sugeno fuzzy system defined as 


Viet Ai(2) 


with the antecedents A;,i = 1,...,n continuous, satisfying (Aj)o = 
[vi-1, igi], i= 1,...,n and the individual rule outputs satisfying b; = f (ai) 
and a; = f'(ai), i=1,...,n. 

Moreover the following error estimate holds true 


lF(f, x) ~~ f(x)Il < 9dw (P58) 


sees ni Xi — vj-1}. 


F(f,2) 


with 6 = max;=1 


Proof. Let us start with Lagrange’s Theorem. If f is continuous on [2;, 2] 
(or [x, 2] if  < x) and differentiable on (x;, x7) (or (x,x;)) then there is a 
c; between x and x; such that 


f(a) = f'(ci)(@ — vi) + f(a). 


Then we have SP  Agle)- f(a) 

ee) 

_ Mier Ai(a) -(F'(ci)(@ — 21) + f(@i)) 
int Ai(2) , 


The Takagi-Sugeno fuzzy system can be written 


_ Lian Ail) - P’@i)(@ = i) + fe) 


F(f.2) EPR 


Then we have 


IF(f,2) — f(x)| = yi, A(z) 
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e Dee Ail) -|fi(ci) — fei le — ei 

7 wey A;(z) 
For a fixed value of x there are only two nonzero terms of the sum i.e., 
x € [xj;-1,2;42] produces the only two nonzero terms A,;(x) and Aj+1(z). 
Then, taking into account properties of the modulus of continuity we obtain 


ye Arla) -w(f. | = 25) le = | 
Wier Ai(z) 

Dien Ail) -w(",36)36 

. die As(2) 


IF(f,x) — f(@)| S 


< 95w(f’, 6). 


Corollary 7.31. Let f be twice continuously differentiable. Then the follow- 
ing quadratic error estimate holds true 


|IF(f,2) — f(a)|| < 96 IP", 
here the norm is the supremum norm. 


Proof. The proof is immediate. a 


Remark 7.32. We observe that the fuzzy sets A;, do not need to be normal. 
Also, we can consider fuzzy systems with more than two overlapping supports 
at a time. For example if 


(Aj)o, (Aj-+1)0, ++ (Aj+r)o 


overlap, then one can obtain the error estimate 


|IF(f,2) — f(a)|| < (7 + 1)*6u (f", 4). 


Remark 7.33. We observe that the Takagi-Sugeno fuzzy system constructed 
with fired membership functions A; is a linear operator. So, TS fuzzy systems 
can be studied using techniques of classical approximation theory. But a TS 
fuzzy system combined with adaptive techniques will not be a linear operator 
any more. 


Theorem 7.34. (Approximation property of higher-order Takagi-Sugeno fuzzy 
system) Let f : [a,b] > R be m times continuously differentiable. The it can 
be uniformly approximated by a higher-order Takagi-Sugeno fuzzy system de- 
fined as 


Dini Ai(2) 
with the antecedents A;,i =1,...,n satisfying (Ai)o = [ei-1, Vi41], 7 = 1,...,0 


and the individual rule outputs being Taylor polynomials about x; of f(x), 
1.€., 


F(f,«) 
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Moreover the following error estimate holds true 


m+1 
5 fO™), 5) 


FCF, 2) — f(a)ll S 


m! 


with 6 = maxy=1,....n1 01 — ia}. 


Proof. We start with a Taylor expansion which insures the existence of &; 
between x and x; such that 
i fE ta 
f(x) = f(ai) + sy ( —aj)t..t fit) —a;)™. 


m! 


OS Ae) 
and so 
Ths Ata): [Feo + S02) +... + Se — ar) 
fe) = ee 


Yat Ai(2) 


The Takagi-Sugeno fuzzy system can be written 


n i Li tn) x4 m 
ie | (ws) + £2 (@ — a) +... + FE f2(@— 23)"] 
7 => — DS SO Ee OCs 

ae A;(z) 
Then we have 
n (m) (gy, (m) (¢, “a 
diet Ai(z) - te) — f(s) |z — xi 
Die Ai(2) , 


Taking into account that x € [#;~1,%;42] produces the only two nonzero 
terms A;(#) and Aj+1(x), we obtain 


7 Din Ai(2) 
7 Die Ai(2) 


gmrl 
mM: 


|F(f, x) — f(@)| = 


IF (f, x) — f(@)| 


Corollary 7.35. Let f be m+1 times continuously differentiable. Then the 
following error estimate holds true 


gmt 


mae | 


IF (f, x) — F(a)ll S 


here the norm is the supremum norm. 
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Fig. 7.5 Approximation by Takagi-Sugeno Fuzzy System. f(x) = sin(6x) (solid 
line) is approximated by Takagi-Sugeno system with triangular (dashed line) and 
Gaussian (dash-dot line) membership functions. 


Proof. The proof is immediate. | 


Remark 7.36. We observe that the fuzzy sets A;, do not need to be normal. 
Also, we can consider fuzzy systems with more than two overlapping supports 
in this higher order system as well. If (A;)o,(Aj+1)o,---,(Aj+r)o Rave non- 
empty intersection, then one can obtain the error estimate 


(r+1)™*1 


IFC.) - FOS per pe 


Example 7.37. We consider the problem of approximating f(x) = sin(6z), 
x € [0,1] by a Takagi Sugeno fuzzy system with 5 rules. 
premise: Ifa is A; then z,=a;x+b;, i=1,...,n 


We can construct the TS fuzzy system in Theorem [7.30] using Gaussian or 
triangular membership functions. The results can be compared in Fig. 


7.6 Fuzzy Control 


A dynamical system is a function which describes the time-dependence of a 
point’s position in space 


®:UCTxM—M, 


where T is either a real interval (for continuous dynamical systems) or it is 
a subset of integers (for discrete dynamical systems), M is a set of states, 


130 7 Single Input Single Output Fuzzy Systems 


coordinates for the system. The behavior of a dynamical system is often 
described by differential equations 


x’ = f(t,x) 


for continuous-time systems, or difference equations 


Tn4+1 = F{tastns At 60), 


for the case of discrete dynamical system. The function f(t,x) besides time 
and coordinate may depend on parameters 


ve’ = f(t,x,u). 


Tn+1 = Flin, 2a; vy LQ, U)- 


This allows us to get a desired position or trajectory by manipulating pa- 
rameters of the system. The evolution of the values of the parameter u that 
give the desired position (track) is called the control signal. Classical control 
engineering uses mathematical analysis to update in time the control signal 
u. The approach needs intense computational and theoretical efforts. 

The idea of Zadeh was to formulate the control algorithmically in terms 
of simple (fuzzy) logical rules. This idea lead to the development of fuzzy 
controllers. 

A fuzzy controller aims to implement fuzzy inference systems in control 
theory. The first fuzzy controller was designed by Mamdani and Assilian 
[107]. Since then many applications have used fuzzy controllers and there 
are several types of fuzzy controllers. A fuzzy controller is essentially a SISO 
fuzzy inference system. Often one may make the confusion to call a SISO 
fuzzy inference system as a fuzzy controller. The usage of this terminology 
is inconsistent with control theory. Fuzzy controller should have the output 
linked into a control system as described above. So in the current work we 
make a distinction between SISO fuzzy system and fuzzy controller. 


7.7 Example of a Fuzzy Controller 


An inverted pendulum has its lower end fixed to a cart (see Fig.[7.6). A fuzzy 
controller has the goal to balance the inverted pendulum. 
The differential equation that describes an inverted pendulum is 


16 — gsin@ = cos 


where 0, are as in the figure. The inverted pendulum system can be con- 
trolled by a fuzzy system described by a set of fuzzy rules. The antecedent 
variables considered in this problem are @ and its derivative 6. The control 
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Ome 


Fig. 7.6 An inverted pendulum 


Fig. 7.7 The membership functions of the antecedents for the angle @ and 0 


signal is u = “, the acceleration of the cart. The antecedents we consider are 
positive big (PB), positive small (PS), near zero (Z), negative small (NS), 
and negative big (NB), both for 6 and its derivative 6 and as well for the 
control signal u (see Fig. [Z.7). 

All the fuzzy sets we consider are described by Gaussian membership func- 
tions with parameters 21, 22,0 different for different variables. 


_@=r)? | 
PB(a) = € | 202 if w<2, 
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Fig. 7.8 The membership functions of the consequences for the acceleration of the 
cart & 
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0.67 
0.5 7] 


0.47] 


0.25 
0.175 


0.04 


Fig. 7.9 The time dependence of the angle 0 for an inverted pendulum with a fuzzy 


controller 
fete, 
NB(z) — e 202 if -a <2 
1 if x<—-a2 


The fuzzy rule base consists of five fuzzy rules 
If 6 is PB and 6 is PB then u is NB 
If 6 is PS and 6 is PS then u is NS 
If 6 is Z and @ is Z then u is Z 
If 6 is NS and 6 is NS then u is PS 
If 6 is NB and @ is NB then u is PB 


0.574 
wal 
os 
| 
0.174 
0.07 


0.17 
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0.2 


° 


Fig. 7.10 The time dependence of the angular velocity 6 for an inverted pendulum 


with a fuzzy controller 


0.35 


Fig. 7.11 The control signal % provided by a fuzzy controller 


A Mamdani SISO fuzzy system provides the output u(6,6). The equation 
of the Mamdani system is 


u(6,6) = 


S 


[o [Vos 4:(@) A BiB) A Ci(2)] «dz 
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and it is used as a parameter in the differential equation of the inverted 
pendulum to stabilize it. The differential equation becomes 


16 — gsin@ = ucosd. 


To solve this equation one can use different numerical procedures. We have 
used a standard Runge-Kutta method, which is outside of the scope of the 
present text. The angle @ as provided by the Runge-Kutta method is rep- 
resented in Fig. [29] The angular velocity is given in Fig. [7.10] The control 
signal that is provided by the Mamdani system is shown in Fig. 


7.8 Problems 


1. Consider a triangular fuzzy number (1,2,4). Find its center of gravity 
defuzzification. Find the expected value of the fuzzy number. 


2. Compare the center of gravity and the center of area defuzzifications for 
fuzzy numbers of trapezoid type. (Numeric example (1, 2,3,6)). 


3. Consider a fuzzy inference system with singleton fuzzifier and a given rule 
base R(x, y). Prove that, for the output of an inference system with any 
t-norm we have 


By) = \J A (a)TR(#,y) = R(ao,y)- 
LEX 


4. Consider a Mamdani fuzzy inference system with two antecedents A, = 
(1,3,5) and Ag = (3,5,7) and two consequences By = (5,10,15) and 
Bz = (10, 15, 20). 

a) Let xo = 4 be a crisp input for the fuzzy system considered. Find the 
firing strength of each rule, then graph the output B’ of the fuzzy inference 
system. 

b) Let xo = 3.5 Find the firing strength of each rule, then graph the 
output B’ of the fuzzy inference system. 

c) Does the output change if we consider the same fuzzy rule base with a 
Godel inference? 


5. Design a SISO fuzzy system that controls a spaceship that has to avoid 
asteroids taking into account the closest one. The variables that can be 
considered are: asteroid is near, relatively close, far. The direction of the 
asteroid’s velocity can be expressed as a linguistic variable as: approaching, 
not approaching, departing. Describe the fuzzy rules and fuzzy controller 
that could control the spaceship. 
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6. Consider the following TS fuzzy system 


if z is Ay and y is B, then z= 2a+y 


if x is Ay and y is By then z = x — 2y 


Consider the crisp inputs 7 = 5 and yo = 6. Also, we know that A,(5) = 
0.7, Ao(5) = 0.5, Bi (6) = 0.6, B2(6) = 0.8. Find the firing strengths of 
each rule and then find the output zo of the TS fuzzy controller. 


7. Consider the fuzzy sets Ay = (1,2,3), A2 = (1,3,4), Bi = (10, 14, 18), 
and By = (14,18, 20), and the following TS fuzzy system 


if a is Ay and y is B, then z= 5a+y 


if a is Ag and y is By then z= 4a+y 


Consider the crisp inputs 7p = 2 and yo = 16. Find the firing strengths of 
each rule and then find the output zo of the TS fuzzy controller. 


8. Describe and implement a SISO version of the room temperature con- 
trol problem discussed in detail previously. The system has the input as 
the room temperature and the output is the defuzzification of one of the 
inference systems used (Mamdani, Larsen, t-norm, Gédel, Gédel residual). 


9. We consider a ball and beam system. This consists of a ball that is rolling 
on a beam that can be tilted. The differential equation that describes a 
ball and beam system has the form 


& = (0)? — gsin@ 


where @ is the angle between the beam and the horizontal direction, while 
x is the coordinate of the ball. The ball and beam system can be controlled 
by a fuzzy system. The antecedent variables considered in this problem 
are x and the angle 6. The control signal is u = 6, the angular acceleration 
of the system. The antecedents we consider are positive (P), and negative 
(N), both for x and @. For the control signal u we consider four fuzzy 
variables positive big (PB), positive small (PS), near zero (Z), negative 
small (NS), and negative big (NB). All the fuzzy sets we consider can have 
trapezoidal or Gaussian membership functions. The fuzzy sets PB, PS, Z, 
NS and NB are as in the inverted pendulum problem. The fuzzy rule base 
consists of five fuzzy rules of the form 
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If x is P and @ is P then u is NS 

If x is P and @ is N then u is PB 

If x is Z and @ is Z then wu is Z 

If x is N and 6 is P then u is NB 

If x is N and @ is N then u is NS 

Construct and implement a fuzzy controller to perform the desired task. 


8 
Fuzzy Analysis 


The topological structure of Fuzzy Numbers was investigated in detail by 
several authors (e.g., Diamond-Kloeden[44], Puri-Ralescu [123], Ma [104], 
Goetschel-Voxman [74]). There are some properties that in a classical Math- 
ematical structure (e.g. that of a Banach space) are easily fulfilled, while in 
the fuzzy setting they do not hold. In this sense, in this chapter we present 
several negative results through several counterexamples. Some of these re- 
sults are known but the counterexamples presented in Sections 8.2] [8.3] [8.4] 
are new, being published for the first time here. Mathematical Analysis on 
Fuzzy Number’s space is an interesting topic (see Anastassiou [4], Bede-Gal 
[18], (20), [19], Chalco-Cano-RomAén-Flores-Jiménez-Gamero [35] Gal [66], 
Lakshimikantham-Mohapatra [98] Wu-Gong [I51]). We study in this chapter 
mainly integration and differentiability of fuzzy-number-valued functions. 


8.1 Metric Spaces of Fuzzy Numbers 


The most well known, and also the most employed metric in the space of 
fuzzy numbers is the Hausdorff distance. The Hausdorff (or in fact Hausdorff- 
Pompeiu) distance for fuzzy numbers (Erceg [56], Puri-Ralescu [123], Diamond- 
Kloeden[44]) is based on the classical Hausdorff-Pompeiu distance between 
compact convex subsets of R”. Let us recall the Definition of the Hausdorff 
distance in this case. 

(i) Let K denote the collection of all nonempty compact convex subsets of 
R” and let A € K. The distance from a point x to the set A is 
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d(x, A) = inf{||a~ — al]: a € A}. 


(ii) Let now A, B € K. The Hausdorff separation of B from A and A from 
B respectively, are 


di;(B, A) = sup{d(b, A): b € B} 
d7,(A, B) = sup{d(a, B): a € A}. 


(iii) The Hausdorff distance between A, B € K is 
dy (A, B) = max{dy(A, B),dy(B, A)}. 


For the particular case when A = [a1, a2], B = [b1, bo] are two intervals (we 
denote A, B € I) the Hausdorff-Pompeiu distance is 


dy (A, B) = max{|a1 _ bi, lag = bo}. 


It is known that with respect to the Hausdorff distance, K (and in particular 
I) is a complete separable metric space. Let us now turn to our object that 
is the metric space of Fuzzy Numbers. 


Definition 8.1. (Diamond-Kloeden [{4]) Let Dx. : Rr x Rr > R+U {0}, 


Deo (u,v) = sup max {lur —v, |, fut — of |} 


ré [0,1] 


= sup {dx (Ur, Ur) }, 
ré[0,1] 


where uy = [u,, ut], vr = [u,v] C R and dy is the classical Hausdorff- 
Pompeiu distance between real intervals. Then D is called the Hausdorff 
distance between fuzzy numbers. 


An L?- type distance can also be defined 


Definition 8.2. (Diamond-Kloeden [44J) Let 1 < p < oo. We define the Dp 
distance between fuzzy numbers as 


D,(u,v) = ( | dis(ur,0)Pdr) 
= (f° max {lar =i. 


The next Theorem gives a list of properties of the Hausdorff distance between 
fuzzy numbers. 


1/p 


? 


1/p 
ut — peat ar) : 
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Proposition 8.3. (Diamond-Kloeden [44J) (i)(RF,Do.) is a metric space 
and moreover, the following properties hold true: 


(it) 
Dox (u+w,vt+w) = Dx (u,v), Vu, v, w € Re, 
2.€., Doo is translation invariant. 
Do (ku, k+v) = |k| Do (u,v), Vu,u € Re, Vk ER; 
(iv) 
Dex (u+v,wte) < Do (u, w) + Doo (v,e) , VU, U, W, € € Re. 
Proof. (i) It is easy to see that 


Doo (u,v) = sup max {|u, —uU, 
re [0,1] 


, [ux — vt |} >0 


with Do (u,v) = 0 if and only if uy = vp,ut = vt,r € [0,1]. Also it is 
obvious that D. (u,v) = Dx (v,u). For the triangle inequality we have 


|u,. — W, | < |u;. — vu, | + luz — w; | 
< Dx (u,v) + Do(v, w) 
and 
jut — wit | < lust — ut | + lot — wr 
< Dxo(u,v) + Dao(v, w) 
which implies 
D(u,w) < Do(u,v) + Doo(v, w). 
As a conclusion (Rz, D..) is a metric space. 
(ii) We have 


Doo (u,v) = sup max {Jur — vp 
re [0,1] 


ur — Ur |} 


3 


= sup max { |u; We. Up SW, 
r€[0,1] 


lu + wf — of — wt} 


= Dx(u+w,v+w). 
(iii) It is easy to see that 


Do (ku, kv) = sup max {|ku; — ku, 
r€ [0,1] 


= |k|Dx (u,v). 


(iv) For (iv) we use the triangle inequality with the translation invariance. 
Indeed, 


' ku — ku |} 


Dx(utv,wte)< Do(utv,wtv)+Do(w+vu,wte) 
= Dx(u,w) + Doo(v, e). 
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Proposition 8.4. (Diamond-Kloeden|{4J, Wu-Gong [151)) Let 1 < p < oo. 
(i) Then (Rr, Dp) is a metric space and moreover the following properties 
hold true: 


(ii) 
Dy (ut+w,u+w) = Dy (u,v) ,Vu,v,w € Re; 
(iti) 
D,(k-u,k+v) = |k| Dp (u,v) ,Vu,v € Re, Vk ER; 
(iv) 
Dy (u+v,w +e) < Dy (u,w) + Dy (v,e) ,Vu,v, w,e € Re. 


Proof. The proof is left to the reader as an exercise. | 


8.2 Completeness 


The following Theorem shows that the Hausdorff distance defines a complete 
metric on fuzzy numbers. 


Theorem 8.5. (Diamond-Kloeden[44]) (R¢, Doo) is a complete metric space. 


Proof. For the proof, we need to show that any Cauchy sequence of fuzzy 
numbers in D. is convergent in Rz. So let u, € Rz,n > 1 be a Cauchy 
sequence. Then for any € > 0 there exists N > 1 with 


Doo(Un; Untp) < e,Vn = N,p = ul 


1.€., 


(un)e = (Uae) 


’ 


sup max{|(tn)y ~ (npn 
ré [0,1] 


he 

This last condition means that the sequences (un), and (un),* are Cauchy 
sequences in R so they converge as sequences of real numbers. Besides, (u,),. 
also converges as a sequence of real intervals in the Hausdorff-Pompeiu dis- 
tance. Let u> and u+ be the limits of the sequences (un) and (u,,)," respec- 
tively. It is easy to see that since (un),/ < (un),, we will have uz < ut and 
M,. = [u;, u;t] is a well defined real interval. We will prove in the next step 
that the sets M, satisfy the hypothesis of Negoita-Ralescu characterization 
theorem [4.8] 

(i) The fact that 1; is a real interval was proven above. 

(ii) Let a < 8. Then we have (un), C (Un)q ie., 


and by taking the limit in this inequality we obtain 
Ug SUg Sug Suz, 


which proves (ii). 
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(iii) Let r, be a convergent sequence r, 7 r. By (ii) we have u, C uy, > 
1 and then 
co 
Ur © () Urn: 
n=1 


We will have to prove the converse inclusion. First let us start with the 
remark that since (um), > u, and (Um) — uj for any €; > 0 there exists 
an M, > 1 such that for m > M, we have 


[(Um)p > (tm) po] S [uy — €1, ur + 1]. 


Since u»,m > 1 is a fuzzy number, we have 


Also, from (Um), + u;, and Gans — uy we have that for any ¢2 > 0 


there exists Mz > 1 such that for m > M2 and any n > 1, 
[uz +€2, ue — €2] C (um), - 


which implies 


Co 
() [up +€2, ut, — €2] C [uy — er, ut +1] 


which leads to 


() Ur, C Ur. 


n=1 


The double inclusion proves (iii) of Negoita-Ralescu characterization 
theorem. 
(iv) Let now r, \, 0 be a sequence in [0, 1]. We will have to prove that 


Since uo is closed and since u,,, C uo the inclusion 


cl (U w] C uo 
n=1 
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is immediate. For the converse we follow a reasoning similar to the previous 
point. Let €1,€2 > 0 be arbitrary. Then we have 


[ug terug —€1] C (tm)o = a (U (om 


n=1 


with m > M,. Also 


cl (U (mn Cel (U [uw — €2, ue + =) ; 


n=1 
for m > Mg. Finally we obtain 


Co 


[ug +e1,uq —€,] Cc cl ( [us —€2,u,, +a ; 


n=1 


€1,€2 > 0. The required relation 


cl (U vn) = Uo 
n=1 
follows. 


Conditions (i)-(iv) imply that u is a fuzzy number, i.e., the Cauchy se- 
quence uy, € Rz converges to u € Re and the proof is complete. | 
The next theorem shows that the L?-type metric for fuzzy numbers is not 
generating a complete space of fuzzy numbers, property which makes the 
L-type metric difficult to be used. 


Theorem 8.6. (Rr, D,) is not complete, 1 < p< oo. 


Proof. We will construct a Cauchy sequence that is not convergent within 
(Rz, D,). In this proof we assume p to be an integer, but the result can be 
extended to real values 1 < p < oo, using special functions. 
Let 
0 if a ¢€[0,n] 


un(a) = { e* if a € [0,n] met 


be a sequence of fuzzy numbers. Its level sets are given by 


(Un)r = { [O,n] if r<e™ 


—Inr if r>e” 


We have 
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Let us denote 
= i (—Inr — n)Pdr. 
We have 


Ip=e"— gone: 
By integration by parts we obtain 
Ip = kPe-*-* + ply-1. 


Also, 


Ip—1 = kP-1e-"-* + (p — 1) Ip-2 
and then 


Ip = kPe—™—* + pkP-le-™-* + v(p — 1) Ip-a. 
By induction we have 


Tp = (KP + pk?-1 +... 4. p(p—1)...2-k)e-"* 


Then we have 


Dy(Un, Un+k) = (ke * + (kP + pkP7} Ae. 


1 
P 


+p(p—1)...2-k)e™"-* + pl (e™" — ee" *))? , 


that is 
Dp (Un, Un+k) 


< ((kP + (k? + pk?! +... + p(p—1)...2-k)— ple” * + ple”)? . 


If k < p we can estimate this Hausdorff distance by 


Dy(un, Un+k) 


IS 


1 
< ((p? + (p? + pp?) + ... + p(p— 1)...2- p) — ple* + pl)? +7 
Now, if k > p then we have 


1 
P 


Dy(Un, Untk) = ((k? + kett — pl)e* + p!) 


and we obtain 
lim D,(un,Un+r) = 0. 
noo 


Then it follows that the sequence u,, is a Cauchy sequence. Now we can see 
that un, does not converge within R-z. Indeed, it converges point-wise to 


Gy 0 if «<0 
UTI) ee if 2 >0 
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Indeed, we have 


Sih 


Datos) = (fo 


—n 


J; yi (—Inr — n)Pdr. 
0 


We have Jo =e” and by integration by parts we get 


(—Inr — nna) 


We calculate 


—n 


Jp =1(—Inr — 1)? [6 +p f r(—Inr — n)?~!=dr, 
0 r 


i.e Jp = pJp—1 which leads to 


—n 


Jp = ple 
Finally we obtain 


1 
i = li le-™)? =0. 
re ee len 
Since u ¢ Re we obtain that Rz is not complete with respect to the metric 
Dy. a 


8.3 Compactness 


A metric space is locally compact if every point has a compact neighborhood. 
This means that we will need to study compact subsets in the metric space of 
fuzzy numbers when considering the different metrics that we have studied in 
the previous sections. A subset of a metric space on its turn is compact if and 
only if it is complete and totally bounded or also, equivalently, if and only 
if it is sequentially compact. Recall that a subspace is sequentially compact 
if any sequence has a convergent subsequence. A compact neighborhood in a 
metric space can be only closed and since it is closed, it contains the closure 
of an open ball that would be at its turn also compact. In (Rr, Dx.) and in 
(Rz, D,) the closed unit ball is the closure of the open unit ball (please note 
that this is not generally true in metric spaces). So, if we succeed to show 
that a closed ball is not compact then the space we consider would not be 
locally compact. So we begin with the following theorem: 


Theorem 8.7. The closed unit ball of (R¢, Dx.) is not compact. 
Proof. The closed unit ball in R¢ is 


B(O, 1) = {ue Re|Do(u, 0) < 1, 
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where we consider the singleton 0 coincident with the real number 0. We will 
construct a sequence without a convergent subsequence. It is known that the 
rational numbers set Q is countable. So let us write it as a sequence gn € [0, 1] 
and we define 


0 if «¢ [0,1] 
Un(2) = Qn if OM ex 3 
2(1—qn)e+2n—-1 if £<a<1 


The level sets of u,, can be written 


(0, 1] if O<r<dn 


Then the Hausdorff-Pompeiu distance level-wise between two elements uy 
and Un+iz of the sequence (qn < dn+k is assumed for simplicity without re- 
stricting the generality) is given as 


0 if O0<r<dq 
r+1l—2qn : 
di ((un)r, (Ue )e) _ F=an), ' if da <1 <ntk 
r+l1—2qn r+1—2qn . 
Baa) i Creer if dn4rSr<l 
We have 
Doo(Un, Un+k) = sup di((Un)r; Ch Nee 
r€[0,1] 
Le., 
r+1—2q, 
Doo (Un; Untk) = sup) = =—————— 
r€[dn,dn+k] 2(1 _ Qn) 
Qntk +1 — 2dn 1 
= OS =, 


This last relation means that the distance between any two elements of this 
sequence is at least 4. Now let us suppose that the sequence u, has a con- 
vergent subsequence. That subsequence would be a Cauchy sequence, which 
is in contradiction with the fact that any two elements of it are at least 4 
apart. This shows that it cannot have a convergent subsequence. So, the unit 
ball is not sequentially compact and as a consequence it is not compact. 


Remark 8.8. It is easy to see that the unit ball is not preferred by compact- 
ness properties over balls with a different radius, so in general we can assume 
that a closed ball is not compact in D...This means that a point in Rz¢ does 
not have a compact neighborhood and this also implies that Ry is not locally 
compact. 


A similar result can be deduced concerning the L? type metrics on fuzzy 
numbers. 
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Theorem 8.9. The closed unit ball 
B,(0,1) = {u € Re|D,(u, 0) < 1} 


in (R¢, Dp) is not compact. 


Proof. We will prove the result for integer values 1 < p < oo, however the 
proof can be extended to the case of real values using special functions. As 
in the proof of the previous Theorem we will construct a sequence of fuzzy 
numbers in the unit ball of (Rz, D,). The construction is similar to the one 
in Theorem [8.6] 

Let 


0 if « ¢ [0,n] 
Un(a) = de n>il 
e(P)P2 if ¢ €[0,n] 


be a sequence of fuzzy numbers. Its level sets are given by 


4 
(0, 7] if pee 
(Un)r = 1 : —( Pn 
—-—rInr if r>e 
(p!)P 


Let us consider the point-wise limit of the sequence 


0) if «<0 
= 1 
an e P)P® if ¢>O0 


It is easy to see that u,(x) < u(x), Va € R. The level-wise Hausdorff distance 
is 


n if r<e @lyPn 


RIE OR 


dy ((Un)r; 0) = 


——lLInr if r>e~@!rn 


(p!) P 
We have 


Pete, 0)= (fa (4), 0P te)" 


- Ul € a nr) a) . 
- (2 f emnpar)’ = (25)". 


To compute J, we integrate by parts and we obtain 


1 
I, =r (-Inr)? ate f (—Inr)?~* dr = plp-1. 
0 
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This shows that J, = p! and we obtain D,(un,0) < 1 that means un € 
B,(0,1) C Re. Using the same calculation as that in the proof of Theorem 
[8.6] we obtain that u, does not converge in (Rr, D,). It is easy to check that 
the sequence is a Cauchy sequence. In a metric space, a Cauchy sequence 
that has a convergent subsequence is itself convergent, but this is not true 
about our sequence un. SO, Uy, does not have a convergent subsequence. As 
a conclusion B,(0, 1) is not compact. 7 


Remark 8.10. It is easy to see that the conclusion can be generalized and a 
closed ball is not compact in Dy. This means that a point in R¢ does not have 
a compact neighborhood and this also implies that Re is not locally compact 
with respect to the Dp metric. 


8.4 Separability 


Separability is another important property mainly for approximation pur- 
poses. A metric space is separable if it has a dense countable subset. Based 
on the same construction ideas as those in the previous sections we will prove 
that (Rr, D,) 1 < p < o& are separable spaces while (Rr, D..) is not separa- 
ble. Let us suppose that there is a dense countable subset Y of a given metric 
space X. If there would be an open ball that is disjoint from the countable 
dense subset Y then the center of that open ball cannot be reached by a 
convergent sequence in Y. As a conclusion the center of the open ball we 
considered would not be in the closure of Y i.e., Y could not be dense in 
X. As a conclusion, to show that a space is not separable it is enough to 
find a family of uncountably many disjoint open balls in X. Then each of 
them would necessarily contain at least an element of Y so there would be 
uncountably many elements in the countable dense subset. Of course this is 
a contradiction. So, to show that a metric space is not separable, it is enough 
to exhibit uncountably many disjoint open balls. 
First we have a positive result about (Rr, Dp). 


Theorem 8.11. The metric space (Rr, Dy) is separable. 


Proof. The proof is following the basic idea of Diamond-Kloeden [44], but it 
is simplified. We consider a fixed fuzzy number u € R-. Since its support is 
compact it is totally bounded, i.e., we can cover it with finitely many balls 
of any given radius « > 0. We can assume that we find a specific minimal 
covering, provided by rational numbers r, < rp < ... < rp as intervals with 
endpoints at rational numbers, of length rj,, — r; < 2¢. We have 
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Also, in this case we have for any level-set 
(Ua © U [ri i421) 
ICI 
with J, minimal. Let us consider now a; rational numbers such that 


a,< sup u(x) <a; te. 
e€[ri,riti] 


Let us define ’ 
u(x) = S- X[ririga] Oe: 
i=1 


It is easy to see that the cardinality of the set of all such functions is the 
same as that of Q, i-e., it is countable. Also, it is easy to see that 


(v)a U [ri Ti+1) 
i€Ja 


where Ja = {ila; > a}. It is easy to see that I, and Jo, consist of the same 
intervals, except possibly they may differ at the end on intervals that have 
length less than 2e. Let 


A={a€ (0, Ildi((w)a, (v)a) < }- 


We can see that [0,1] \ A C [rj,7541) U [re, re41) for some j,k € {1,...,n}. 
We can conclude 


<e+4e-diam(u)o. 


As a conclusion we find an element v of a countable set in any neighborhood 
of a fuzzy number u € R- with respect to the distance D, and this completes 
the proof. | 


Now let us prove that (Rr, D..) is not separable. 


Theorem 8.12. The closed unit ball 
B(0,1) = {u € Rz¢|Dx(u, 0) < 1} 


in (Rr, Dx) is not separable. 
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Proof. The construction is similar to that in Theorem For a given t € 
(0, 1] we define 


0 if «¢ 0,1] 
Uur(x) = t if O<a<$ 
2l—t)e+2-1 if $<a<1 


The level sets of u; can be written 


(0, 1] if O<r<t 
(ut), = [1] if t<r<l 
Then the Hausdorfft-Pompeiu distance level-wise between two elements wuz 
and us of the sequence, t < s is given as 


0) if O<r<s 
dy ((ut)r,(Us)r) = Ey if t<r<s 


(1-t) 
r+1—2 r+1—2s “ 
aaa) - ay LL ees 


We have 


So the open balls B (ut, z) are disjoint and uncountably many. So a countable 
dense subset if there would exist, would need to have an element in each 
such ball, which is impossible. So, the closed unit ball in (Rr, D..) is not 
separable. | 


It is known that a metric space is separable if and only if it is Lindel6f (i-e., 
any open covering has a countable sub-cover). We can conclude that the space 
(Re, Doo) is not a Lindeléf space, while (R¢, D,) is Lindelof. 

As a consequence we can mention two of the problems which should be 
avoided when we want to use the metrics over the fuzzy reals. First, if we 
have a Cauchy sequence in (R-, D,), for 1 < p < co we cannot be sure about 
its convergence. In (Rr, Dx) we cannot use a density argument (we cannot 
reduce a problem to a sub-problem of a countable dimension). Finally in both 
(Rr, Dx.) and (Rr, D,) we face serious difficulties when we want to extract 
a convergent subsequence of a bounded sequence. 

The fuzzy analysis literature is using mostly the Hausdorff distance be- 
tween the fuzzy numbers, because in this case the structure of the metric 
space (Rz, D,) being complete, is near to the structure of a Banach space. 
Surely we do not have a linear space structure, so it cannot be a Banach space, 
but several properties which hold in Banach spaces also hold in (Rr, Dx). 
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8.5 Norm of a Fuzzy Number 


Let us denote ||ul|- = Dx (u,0), Vu € Re the norm of a fuzzy number. The 
following theorem shows us that this has properties similar to the properties 
of a norm in the usual crisp sense, without being a norm. It is not a norm 
because R# is not a linear space. 


Proposition 8.13. (Anastassiou-Gal [5/, Gal [69J)||-||- has the following 
properties 

(i) ||u||- = 0 if and only if u = 0; 

(it) \|A- ullz = |Al- |lull-, VA ER and u € Re; 

(iit) |lu + alle < [lull + llollz Vu,v € Re; 

(iv) |llullz — llullzl S Doo (u,v) ,Vu,v € Re; 

(v) For any a and b having the same sign and any u € Re we have 


Doo(a-u,b-u) = |b—al- lulls; 


(vi) Doo(u, v) = |lu gx U||-,Vu,v € Re. 


Proof. The proofs of (i)-(iv) and (vi) are left to the reader as an exercise. 
We will prove (v). Let u€ Rr, and a > b > 0. Then we have 


Dxo(a-u,b-u) = Do([b+ (a— 6)]-u,b-u) = Do(b- ut (a—b)-u,b-u). 
Since Dy is invariant to translations we get 


Doo (a+ u, b+ u) = Doo((a — 6) - u, 0) = |b— al - |lullz. - 


Remark 8.14. The concepts of limit, convergence of a sequence in R¢ and 
continuity of a function f : [a,b] > Re will all be considered in the metric 
space (Rr, D.). For example continuity of a fuzzy number valued function 
at a point x9 means that Ve > 0,56 > 0 such that Do(f (x), f(a0)) < € for 
|x — xo| < 6. From the definition of the Hausdorff distance this implies 


sup max{|f, (x) — fr (o)l, lf (@) — fr @o)|} <e€ 
ré[0,1] 


which results in | f(x) — f#(xo)| < ¢,Vr € [0,1], t.e., equicontinuity of the 
family {f=|r © [0,1]}. In particular it also means that these functions are 
continuous. 


The algebraic-analytic properties of fuzzy number’s space makes them very 
interesting. Recently in Gal [69] it was shown that the general properties 
shown in Theorem[.8] and[8.3lallow a generalization in a natural way yielding 
the definition and study of the following abstract space. 
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Definition 8.15. We say that (X,+,-,d) is a fuzzy-number type space (shortly 
FN-type space), if the following properties are satisfied : 

(i) (X,d) is a metric space (complete or not) and d has the properties in 
Theorem [8.3] 

(ii) The operations +,- on X have the properties in Theorem[5.8) (i), (iv), 


(v),(vi); 

(iit) There exists a neutral element 0 € X,i.e.u+0=0+4+u = 4, for any 
ué X anda subspace Y C X (with respect to + and-), non-dense in X, such 
that with respect to 0, none ofu€ X \ Y has an opposite element in X. 


Obviously (Rz, Doo), (Rr, Dp) are both FN-type spaces. The uniform dis- 
tance is defined as in the usual case for continuous functions f,g : [a,b] > Rr 


D(f,g) = sup{ Doo (F(x), g(@)|a € [a, b]}. 


Then (C[a, b], D) is an FN-type space. Indeed, because (Ry, D) is a complete 
metric space, it is easy to prove that (C ([a, 6]; Rx), D) is a complete metric 
space. Also, if we define 


(f +9) (x) = f (x) +9(z), 
(A: f) (a) =A- f (x) 


(for simplicity, the addition and scalar multiplication in C'([a,b];Rz) are 
denoted as in Ry), also 0: [a, 6] > Rz,0(t) = 0, for all t € [a, 8], 


IIfll- = sup {D (0, f(x); 2 € [a, 6] . 


Other examples and several new properties were shown in Gal [69}. 


8.6 Embedding Theorem for Fuzzy Numbers 


In the followings we will discuss an embedding result concerning fuzzy num- 
bers. 

Let C[0,1] = {F : [0,1] — R; F bounded on (0,1), left continuous for 
x € (0, 1], right continuous at 0}. Together with the norm 


I|F | = sup{|F(a)|;@ € [0, 1}, 


C[0, 1] is a Banach space. We can embed R¢ into the Banach space C{0, 1]? 
according to the following theorem: 


Theorem 8.16. (Ma [704)) Let 


j: Rx > C[0,1] x C[0, 1] 
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given by 

j(u) = (u-,u*), 
where u-,ut : [0,1] > R, u(r) =u, ut(r) = ut. Then j(Rr) is a closed 
convex cone having its vertex at 0 in C0, 1] x C[0,1]. Here C0, 1] x C(O, 1] 


is a Banach space w.r.t. the norm 


Cf, 9) = max{||fll, llall}- 


Moreover, j satisfies: 
(i) 
j(a-u+b-v) =aj(u) + bj(v), 
Vu,uv € Re, a,b > 0; 
(i) 
Doo (u,v) = |[9(u) — J(v)|I- 
Proof. The representation of a fuzzy number through the functions u~, ut 
in Theorem [4.10]ensures that 7 is well defined and injective. We can deduce 
based on the same theorem, that 
j(RF) = {(u~, ut) € C[0, 1]?|u7-nondecreasing, 
ut-nonincresing, uy < uf}. 


To check that it is closed it is enough to observe that taking a sequence of 
elements in j(R+) has monotone components that converge to a monotone 
limit in the uniform norm. Also, convergence keeps the relation uy < uf 
intact and so, the space j(R-) is closed. Considering now 


(aa), (v-, vt) € j(RF) 


and a,b > 0 we have 


j(a-u+b-v) =a(u_,ut) +b(v, vt) = aj(u) + bj(v), 


which proves (i) and also the fact that j(R+) is a convex cone. To prove (ii) 
we observe 


I|5(u) — F(v)|| = max{ sup jus —v, |, sup |ujt — ut |} = Doo(u,v), 
r€(0,1] r€(0,1] 


and the proof is complete. | 


8.7 Fuzzy Numbers with Continuous Endpoints of the 
Level Sets 


Let us now consider the set of fuzzy numbers such that the left and right 
endpoint of the level set functions are continuous. 


R& = {u € Relur = [u, ut], ue € ClO, I}. 
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Let us observe that this space does not coincide with the space of fuzzy 
numbers with continuous membership degrees. Indeed, for example single- 
tons, and crisp intervals regarded as fuzzy sets through their characteristic 


functions 
Ge 1 if aw € [a,}} 
wer 5) otherwise 


are discontinuous while the level-set functions associated to them will be con- 
tinuous. The level set functions in this case being constant u; = a,u;t = b,r € 
(0, 1] they are continuous, while the characteristic function is discontinuous. 
Also, there are fuzzy numbers’ with continuous membership 
function such that the level set functions u; are discontinuous. It is enough 
to consider wu : [0,4] — [0,1], 


3 if a € [0,1) 
|) 2. at ee 12 
wr)=) 2 if ee [2,3] 
4—a% if x€ [3,4] 
and we have u; = 1 while lim,..1 (u,;) = 2. As we can see restriction to 


continuous endpoints of the level set is not too restrictive. 

Another research direction (see Rojas-Medar and Roman-F lores [126] Barros- 
Bassanezi-Tonelli [[2]), which is leading to a larger space within fuzzy num- 
bers space is to consider those fuzzy numbers which do not have a proper 
local minimum of their membership function, i.e., there is no 0 < 2 < 1 
such that u(ao) < u(x) in a neighborhood z € [a9 — €, 29 + ¢] and their core 
consists of a single point. The subset of fuzzy numbers obtained by these 
restrictions will be separable and complete. 

In most of the situations we try to address the more general space of fuzzy 
numbers without any restriction. 


Proposition 8.17. R& with D. is a separable, complete metric space. 


Proof. First let us observe that being a closed subspace of a complete metric 
space, RS is complete. Let us consider C0, 1] the Banach space of continuous 
real-valued functions on [0, 1] and the embedding 


jg: RE - C0, 1] x C0, 1 


given by 
j(u) = (u,u*), 


where u~,u* : [0,1] > R, u(r) = uz, ut(r) = ut. Then j(Re) is a closed 
convex cone having its vertex at 0 in C[0, 1] x C[0,1] with the norm 


Cf, 9) = max{|| Il, llall}- 


The embedding 7 is the same as the one defined in an earlier section but its 
image is now within the space of continuous functions. Being isometrically 
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embedded in a subspace of C/[0,1] each component of j(R¢) is separable 
according to the Banach-Mazur theorem. Then as a consequence itself j(R¢) 
is separable and so is R¢ itself. |] 


Remark 8.18. It is well known that the closed unit ball in C[0,1] is not 
compact, so clearly the closed unit ball in R& will not be compact. Bounded- 
ness and continuity of elements of a subset of a function space is insufficient 
for compactness. It is replaced by equicontinuity in e.g. Arzela-Ascoli type 
results. 


8.8 Integration of Fuzzy-Number-Valued Functions 


In is easy to observe that the definition of the integral of a fuzzy-number- 
valued function does not raise serious problems. In the followings Aumann, 
Riemann and Henstock type integrals will be introduced. 

First we introduce an Aumann-type integral, used in several works. 


Definition 8.19. (Diamond-Kloeden [{4]) A mapping f : [a,b] + Re is said 
to be strongly measurable if the level set mapping [f(x)]a are measurable for 
all a € [0,1]. Here measurable means Borel measurable. 

A fuzzy-valued mapping f : [a,b] > Re is called integrably bounded if there 
exists an integrable function h : [a,b] + R, such that 


If Olly < h(t), Vt € la, | 


A strongly measurable and integrably bounded fuzzy-valued function is called 
integrable. The fuzzy Aumann integral of f : [a,b] > Rx is defined level- 
wise by the equation 


b e b 
(FA) [ roa =| PGT day pe 16, 11, 


The following Riemann type integral presents an alternative to Aumann-type 
definition. 

Definition 8.20. (Gal [66/) A function f : [a,b] + Re, [a,b] C R ts called 
Riemann integrable on [a, bl, if there exists I € Re, with the property: Ve > 0, 
46 > 0, such that for any division of [a,b], d: a= 29 < ... <n = b of norm 
v(d) <6, and for any points &; € [a;j,v:41], 1 =0,...,.n—1, we have 


Dx (< Ff (&) (@i41 — 24) 1) <6: 


Then we denote I = (FR) ie f (x) dx and it is called fuzzy Riemann in- 
tegral. 


8.8 Integration of Fuzzy-Number-Valued Functions 155 


In Wu-Gong the Henstock integral of a fuzzy-valued function is intro- 
duced. Surely as a particular case the Riemann-type integral of a fuzzy-valued 
function can be re-obtained. 


Definition 8.21. (Wu-Gong [15iJ, Bede-Gal J19])Let f : [a,b] > Re a 


fuzzy-number-valued function and 
Ani @=% <2 <1... <Un-1 <p =) 
a partition of the interval [a,b], & € [xi,vi41],¢ = 0,1,...,2 —1, a sequence 


of points of the partition A, and 6(x) > 0 a real-valued function over [a, b]. 
The division P = (Ap, &) is said to be 6-fine if 


(aera |S (Ee (Ee) Set (Ge) 


The function f is said to be Henstock (or (FH)-) integrable having the integral 
I € Re if for any € > 0 there exists a real-valued function 6, such that for 
any 6-fine division P we have 


n-1 
De (Ere hot) <é, 
1=0 


where hy = x41 — x;. Then I is called the fuzzy Henstock integral of f and 
it is denoted by (FH) L f (t) dt. 


Proposition 8.22. A continuous fuzzy-number-valued function is fuzzy Au- 
mann integrable, fuzzy Riemann integrable and fuzzy Henstock integrable too, 
and moreover 


b b b 
(FA) / Fed m / f (a) dx = (FR) / Fita\de, 


Proof. It is immediate to observe that 


wa [sea] = [fe (ar, fs 9 a Wr € [0, 1]. 


If f is Riemann integrable then it is also Henstock integrable. Indeed, if the 
function 6 is constant in the Henstock definition, it will generate the Riemann 
case. The Riemann sum can be written level-wise 


ps Ff (&) (tina — “i 


i=0 


7 x Fr (Si) (ti4a - a), ft (i) (Gi41 - =] 
i=0 


i=0 
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Equicontinuity implies integrability of the functions f~ and f,* uniformly 
w.r.t. r € [0,1]. Then we obtain 


wn) [seas] = [fe wa [Foye 


and combining the above results we obtain the equality of the three types of 
integrals. a 


The common value of these integrals for a continuous function f : [a,b] — Rr 


will be denoted by i f (x) dx. For general f : [a,b] + Rz the above assertion 
does not hold. 

The properties of the integrals for fuzzy functions are similar to the prop- 
erties of their classical counterparts. 


Proposition 8.23. (Gal [66/) The fuzzy integral has the following properties. 
(i) If f,g: [a,b] > Re are integrable and a, 8 € R we have 


[os + Bg(x))dx = af seme ze Bf ater 


(ii) If f : [a,b] + Re is integrable and c € [a,b], then 


[ tae + [sear 7 [seo 


(iii) If ce Re and f : [a,b] > R has constant sign on [a,b], then 


fe (w= ef some 


For general f the property does not hold. 


Proof. The proof is left as an exercise. | 


Example 8.24. (Bede [14 Let us consider the Green function on [0,1] 


interval 
=s(1.— t 
Ce) = { -t(1—s), s>t 
Then ; : 
y(t) =i Glt,s)(0,1,2)ds+ [ G(t, s)(0, 1, 2)ds 
0 t 


=f eee eel p,ojds+ [i pit 2), 30-3), Oa: 
0 t 


We can integrate the terms level-wise and we obtain 


y(t) = ( —t, se - 0,0) 
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8.9 Differentiability of Fuzzy-Number- Valued 
Functions 


The Hukuhara derivative of a fuzzy-number-valued function was introduced 
in Puri-Ralescu and it has its starting point in the Hukuhara derivative 
of multivalued functions. The approach based on the Hukuhara derivative 
has the disadvantage that a differentiable function has increasing length of 
its support interval (Diamond [45]). This is not always a realistic assumption. 
Strongly generalized differentiability of fuzzy-number-valued functions is in- 
troduced and studied in Bede-Gal [20]. In this case a differentiable function 
may have decreasing length of its support. Recently this line of research was 
continued by introducing gH-derivative and the g-derivative (Bede-Stefanini 
[27)) of a fuzzy-valued function. 


8.9.1 Hukuhara Differentiability 


Definition 8.25. (Puri-Ralescu [123], Hukuhara [79]) A function f : (a,b) > 
Re is called Hukuhara differentiable if for h > 0 sufficiently small the the H- 
differences f(a +h) © f(x) and f(x) © f(x —h) exist and if there exist an 
element f'(x) € Re such that 


The fuzzy number f'(x) is called the Hukuhara derivative of f at x. 
Definition 8.26. (Seikkala [131/) The Seikkala derivative of a fuzzy- 
number-valued function f : (a,b) + Re is defined by 

f'(e)r = (fr (@)Y Fe (@))'1, 
O0<r<_1, provided that it defines a fuzzy number f(x) € Re. 


Remark 8.27. Suppose that the functions f(x) and f,*(x) are continuously 
differentiable with respect to x, uniformly with respect to r € [0,1]. Then f is 
Hukuhara differentiable if and only if it is Seikkala differentiable and the two 
derivatives coincide. Indeed, if f is Hukuhara differentiable we can write 


lim f(z+h)e f(z) 
hN,O h 
im SEM =I), HE@+M) ~ £0) 
hANO h h\,O h 


relation that shows that fis Seikkala differentiable. 
Reciprocally if f is Seikkala differentiable then we have its length 


len(f(2)r) = fr (2) — fr (2) 2 0, 
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which implies the existence of the Hukuhara difference f(x +h) © f(x) and 
considering the limit with h \, 0 we get Hukuhara differentiability. The equal- 
ity of the two derivatives is immediate. 


Proposition 8.28. A Setkkala differentiable function has non-decreasing 
length of the closure of the support. 


Proof. Indeed, by supposing the contrary, let f : (a,b) + R¢ be such that 
len(f(x)) is decreasing for some neighborhood of «x € (a,b). Then we have 


[f’(@)]o = [(fo (#))' (fo (@))'1. 


Since len(f(x)) = f(x) — fo (x) is decreasing we obtain a contradiction. 
Moreover, if for some x € (a,b), f’(x) ERz \ R then len(f(x)) is strictly 
increasing. | 


Example 8.29. (i) If 


is triangular number-valued function, then if u is Hukuhara differentiable and 
x,y,z are real-valued differentiable functions then 


f= (a(t), 9), 2) 


is a triangular fuzzy number. 

(ii) Let f(t) = (—e',0,e*). Then f’(t) = (—e®,0,e*%). And in this case, it 
is easy to see that f'(t) = f(t) but also, f’(t) = —f(t). 

(iti) Let f(t) = (1,2,3)e~*. Suppose that f(t) is differentiable. Then we 
would have f'(t) = (—e~', -2e~*, —3e~") which is not a fuzzy number. 


The following example shows a disadvantage of the Hukuhara derivative. 


Example 8.30. Let c © Re and gq: (a,b) > Ry be differentiable on xp € 
(a,b) and let us define f : (a,b) > Re by 


f(x) =c- g(x), x € (a,b). 


Let us suppose that g'(xo) > 0. Then for h > 0 sufficiently small, since g is 
increasing on |[%o,2o + h] we obtain 


g(%o +h) — g(%o0) = w(a0,h) > 0. 
Multiplying by c, it follows 
c-g(%o +h) =c- g(xo) +c: w(xo,h), 


i.e. there exists the H-difference f(xo +h) © f(ao). Similarly, reasoning as 
above we get that there exists the H-difference f (xo) © f(xo — h) too. Also, 
simple reasoning shows in this case that f'(xo) = c-g'(xo). Now, if we suppose 
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g'(ao) < 0, we easily see that we cannot use the above kind of reasoning 
to prove that the H-differences f(a + h) © f(xo), f(%o) © f(xo — h) and 
the derivative f'(xo) exist. Consequently, we cannot say that f'(ao) exists. 
Moreover, we can easily prove that if g'(ao) < 0 then the Hukuhara differences 
f(xo + h) © f(x), f(xo) S f(wo — h) cannot exist, so the function is not 
Hukuhara differentiable. 


8.9.2 Generalized Differentiabilities 


The definition of strongly generalized differentiability was introduced in Bede- 
Gal [18], Bede-Gal [20]. 


Definition 8.31. (Bede-Gal [20]) Let f : (a,b) > Re and xo € (a,b). We 
say that f is strongly generalized differentiable at xo, if there exists an 
element f'(ao) € Re, such that 

(i) for allh > 0 sufficiently small, Af (xo + h) © f(xo), f (v0) © f (ao — h) 
and the limits (in the metric D) 


lim f(xo +h) © f(xo) _ fies f(%o) O f(to—h) _ 
h\O h ~ AXO h 


or 
(ii) for allh > 0 sufficiently small, Sf(xo) © f(to +h), f(ao — h) © f (xo) 
and the limits 


_ t(to)Of(@ot+h) 5. flto-h)Of(to) _ pp 
a) ee = Ge 


or 
(iii) for allh > 0 sufficiently small, Af(xo +h) 8 f(xo), f(@o —h) S f (x0) 
and the limits 


lim f(zo +h) © f(xo) _ ia f(to —h) © f(to) _ 
h\o h AN (—h) 


or 
(iv) for allh > 0 sufficiently small, 4f(xo) 6 f(xo +h), f(x0) SO f (xo — h) 
and the limits 


h\,0 (—h) - h\,O h 
(h and (—h) at denominators mean +: and —#-, respectively) 


Case (i) of the previous definition corresponds to the Hukuhara derivative 
discussed in the previous section. 
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Remark 8.32. 1) This definition is not contradictory, i.e. if for f and xo, 
at least two from the possibilities (i)-(iv) simultaneously hold, then we do not 
obtain a contradiction. Indeed, let us suppose, for example, that (i) and (itt) 
hold. Then by 


f(xo +h) = f(xo) + A, 
f (xo) = f(@o —h) + B, 


( 
f (xo — h) = f(to) +C, 


with A,B,C € Re, we get f(xo) = f(ao) + B+C but this means B+C =0, 
which implies B = C = 0, i.e, f’(xo) = 0, or B,C € R, B = —C, case 
when f'(ao) € R. But in all fete cases it is easy to see that all the limits 
in the previous definition are equal. Similar conclusion follows for any other 
combination from (1)-(iv). 

2) Let f : (a,b) > Re be strongly generalized differentiable on each point 
x € (a,b) in the sense of Definition[8.31] (iti) or (iv). Then f'(x) € R for all 

€ (a,b). 


Example 8.33. If g: (a,b) > R is differentiable on (a,b) such that g’ has 
at most a finite number of roots in (a,b) and c € Re, then f(x) = c- g(x) 
is strongly generalized differentiable on (a,b) and f'(x) = c- g'(a), Vr € 
(a,b). Indeed, if g/(x) > 0, as we have seen above the function is Hukuhara 
differentiable and so it is strongly generalized differentiable too. If g'(x) < 0 
then the differences f(ao) C f(ao +h), f(vo — h) © f(ao) exist, and the (ii) 
case of the above definition[8.31]] is satisfied. As g'(x) =0 may involve a sign 
change, it results in a case (iti) or (iv) of the above definition. 


The concept in Definition [8.31] can be further generalized as follows. 


Definition 8.34. (Bede-Gal [20]) Let f : (a,b) > Re and xo € (a,b). For a 
sequence hy, \, 0 and no € N, let us denote 


ce = {n 2 ig; SEN? = f (zo he Rn) Ke Fae Xo 


I} 
AX a {n > no; SEY) := f (x0) hn), 
hn) 


Als) — {n > no; SES) := f (x0) 


A® = {n> n9,3BO = F (0 — hn) © F(a0)}- 


We say that f is weakly generalized differentiable on xo, if for any se- 
quence hy, \, 0, there exists no € N, such that 


AY UA) VAS UA® = {n € Nin > no} 
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and moreover, there exists an element in R¢ denoted by f'(xo), such that if 
for some j € {1,2,3,4} we have card( A) = +00, then 


EY) ; 
ieee Cajitin, Fo) = 0. 


Example 8.35. Let c € Re and g: (a,b) > R. If g is differentiable on xo 
(in usual sense), then the function f : (a,b) > Re defined by f(x) =c- g(x), 
Va € (a,b), is weakly generalized differentiable on xp and we have f'(xo) = 
c+ g' (x0). 

Let f(t) = (1,2,3)e~*. Then it is easy to see that f’(t) = —(1,2,3)e* = 
(—3e—*, -2e-*, -e*). 

Let f(t) = (1, 2,3) sint, then f’(t) = (1, 2,3) cost, Vt € R. 
Proposition 8.36. If u(t) = (a(t), y(t), z(t)) ts triangular number valued 
function, then 

a) If u is (i)-differentiable (Hukuhara differentiable) then u! = (a’,y’, 2’). 

b) If u is (ti)-differentiable then u' = (z',y’, 2’). 


Proof. The proof of b) is as follows. Let us suppose that the H-difference 
u(t) © u(t + h) exists. Then we get: 


(a(t) — a(t +h), y(t) — y(t +h), 2(6) — z(t +h)) 


: 2(t)— z(t +h) y(t)—y(t+h) a(t) — a(t +h) 
= ln | ———_,_,  ——  _,, — 
h\O —h —h —h 
= (2',y',2') 
Similarly 
: u(t—h) Out) _ Pe oP top 
a —h —_ (z oY »z ); 
and the required conclusion follows. | 


Other generalizations were recently obtained. 


Definition 8.37. (Stefanini-Bede [141], Bede-Stefanini [27|) Let 29 € (a, b). 
Then the fuzzy gH-derivative of a function f : (a,b) > Re at xo is defined 
as 


fu(00) = lim =[f (20 +h) Ogu F (20) 


If ie 7 (Zo) € R= exists, then we say that f is generalized Hukuhara differen- 
tiable (gH-differentiable for short) at zo (Og# is the gH-difference) . 
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Theorem 8.38. (Bede-Stefanini [27/) The gH-differentiability concept and 
the weakly generalized (Hukuhara) differentiability given in Definition [8.34] 
coincide. 


Proof. Let us suppose that f is gH-differentiable (as in Definition [8.37). For 
any sequence h, \, 0, for n sufficiently large, at least two of the Hukuhara 
differences f(xo +hn) Gx f(xo), f(to) Ox f(@o + hn), f(@o) Ou f (0 — hn), 


f (xo — hn) Gx f (xo) exist. As a conclusion we have 


AW U AQ) U A®) U AM) = {ne N;n> no} 


for any no € N. Now we observe that 


EY) = f (to + hn) Ogu f (x0) 
(-1)3*thy hin , 


so f is weakly generalized differentiable. 
Reciprocally, if we assume f to be weakly generalized differentiable then 


since at least two of the sets AY), A), AS) A@ are infinite we get 
1 BY) 
lim + [f(xo +h) Ogu f(0)] = HO open, 


for at least two indices from j € {1,2,3,4}, so f is gH-differentiable. As a 
conclusion weakly generalized (Hukuhara) differentiability is equivalent to 
gH-differentiability. a 


Theorem 8.39. (Bede-Stefanini [27]) Let f : (a,b) + Re be such that 
(f(z)lo = [fa (x), fa (x)]. Suppose that the functions fy (x) and ft(x) are 
real-valued functions, differentiable with respect to x, uniformly in a € (0, 1]. 
Then the function f(a) is gH-differentiable at a fixed x €]a, bl if and only if 
one of the following two cases holds: 

a) (fx) (a) is increasing, (ft) (x) is decreasing as functions of a, and 


(fr) (2) < (ft) (@), 


or 
b) (fs) (x) is decreasing, (ft) (x) is increasing as functions of a, and 


(ft)! (x) < (FF) (2). 


Moreover, Ya € [0,1] we have 


[fou (2)] , = bnin{(fz)' (x), (FE) @)} 


,max{(fz)’ (x), (f2)' @)}]- 
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Proof. Let f be gH-differentiable and assume that fy (2) and f{(x) are 
differentiable. Clearly, gH-differentiability implies that level-wise we have 


[For (x)|, = [(fz)’ (2), (Ft)’ ()]- 


7 / ws 
[fou(2)], = (Fe) (2), fa) (2))- 
In the first step let us suppose that there is a sign change in the difference of 


derivatives (ft)’ (x) — (fz)’ (x) at a fixed ag € (0,1). Then [foe (2)| 7 isa 


singleton and, for all a such that ag < a < 1, also [foa(2)] is a singleton 
because 


[fou (@)], S [foar(2)] os 
it follows that, for the same values of a, 
(fa)' («) - (fa) (2) =0 


which is a contradiction with the fact that (ft)’ (x) — (fy )’ (x) changes sign. 


Qa 


We then conclude that (f*)’ (a) — (fz )’ (x) cannot change sign. 
Case 1. If (fy )’ (x) < (fit)' (x) then 


(f2)' (2) -— (fa) (@) 20 
for every a € [0,1] and 
[fa@),=(G) @i G2) @k 


since f is gH-differentiable, the intervals [(fz)’ (x), (ft)’ (z)] should form a 
fuzzy number, i.e., for any a > £, 


(Fa) @), (62) @)c (7) @. (4) @) 
which shows that (fy )’ (x) has to be increasing and (ft)’ (x) needs to be 
decreasing as a function of a. 


Case 2. If (f7)’ (x) > (fi*)' (2), then 


(ft)' (2) — (fa)’ (x) <0 


for every a € [0,1] and, in this case, 


so we get 
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for any a > 6, which shows that (fy)’ (x) is decreasing and (ft)’ (x) is 
increasing as a function of a. 


Case 3. If we have 
(fr) @) = (FY @) 
and if (fgzr)’ (x) € R is a crisp number, the conclusion is obvious. Otherwise 
we may have either 
(fo) (@) < (fF) @) 
or 
(fo) (@) > (fF) @) 


when a@ < ap and equality 


(fo) (@) = (ft) @) 


for @ > ao. We have in this case the monotonicity satisfied. 

Reciprocally, let us consider the Banach space B = C[0, 1] x C[0, 1], where 
C[0, 1] is the space of left continuous functions on (0, 1], right continuous at 
0, with the uniform norm. For any fixed x € (a,b), the mapping j, : Rr > B, 
defined by 


jo(f) = (fF (2), F* (a) = {(fa (@), fa (2))le € [0, 1}, 


is an isometric embedding. Assuming that, for all a, the two functions f> (x) 
and f(z) are differentiable with respect to x, the limits 


/ : =(ee fy Foe 
(fz)! (@) = tim 2244) — fale) 


oe oe 
(f2)' (2) = Jim += fee) 


exist uniformly for all a € [0,1]. Taking a sequence h, + 0, we will have 


fc (@ + hn) = fa (2) 


n—0o An 
( +)! (x) = Jim, Ae SE fa) _ Fo (a) 


ie., (fa) (x), (ft) (x) are uniform limits of sequences of left continuous 
functions at a € (0, 1], so they are themselves left continuous for a € (0, 1]. 
Similarly the right continuity at 0 can obtained. 

Assuming that, for a fixed a € [a,b], the function (f7)’ (x) is increasing 
and the function (f*)’ (x) is decreasing as functions of a, and that 


(f7)' (@) < (ft) @) 


then also 


(fa) (a) < (fe) (a), Va € [0, 1] 
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and it is easy to see that the pair of functions (f7)’ («), (f+)’ (x) fulfill the 
conditions in Theorem and the intervals 


[(fa)’ (2), (fa) (@)], a € [0,1] 


determine a fuzzy number. Now we observe that the following limit uniformly 


exists 
| lim Jet) Sant a 
h-0 h ey 
— |tim Jet) — fale) 5 fale +h)~ fa) 
~~ | ho h a0 h 


= (fa) (@), (fa) (@)], Vo € [0,1], 
and it is a fuzzy number. As a conclusion, finally we obtain that f is 


gH-differentiable. The symmetric case being analogous, the proof is 
complete. Py 


Remark 8.40. Any of the derivative concepts defined above can be restricted 
to the case of closed real intervals. For example f : (a,b) + 1, with 


I= {[a, blla < b,a,b € R} 
has its gH-derivative (Stefanini-Bede [141)) 


= [min{(f~)' (a), (f*)' (@)}, max{(f-)’ (@), (F*)' @)}- 
This expression always represents a well-defined real interval. 


Based on the g-difference, we consider the following g-differentiability con- 
cept, that further extends the gH-differentiability. 


Definition 8.41. (Stefanini-Bede [27]) Let xo € (a,b). Then the fuzzy 
g-derivative of a function f : (a,b) > RF at xo is defined as 


. tL 
f,(o) = jim FI f(xo + h) Og f(xo))- 
If fj(to) € Re exists, we say that f is generalized differentiable 
(g-differentiable for short) at xo. 


Remark 8.42. We observe that the g-derivative is the most general among 
the previous definitions. Indeed, 


f(to +h) Og f (x0) = f(to +h) Ogu f(xo) 


whenever the gH-difference exists. This also implies that fj(x) = gH (2) 
whenever this later exists. 
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In the following Theorem we prove a characterization and a practical for- 
mula for the g-derivative. 


Theorem 8.43. (Stefanini-Bede [27)) Let f : [a,b] + Ry be such that 


[f(2)]. = [fa (x), fa ()], « € [0, 1]. 


If f(x) and ft (x) are differentiable real-valued functions with respect to x, 
uniformly with respect to a € [0,1], then f(a) is g-differentiable and we have 


[f(a], = jaf min{ (fz) ©: (4) @b-supmaxt (fz) (48) oo | 
Proof. By Proposition [5.19] we have 


[f(@ +h) Og F(a)lo 


al ae 


1 


= zLinf min f(e + hg — fle)g. e+ - S@)$}, 
sup max{ f(a + h)z — fle)g. f(e + h)f — f(a) SL. 


Bea 


Since f, (x), ft (x) are differentiable we obtain 


- jaf mint (fz) @: (8) @b-supmaxt(iz) @) (GF) oo 


for any a € [0,1]. Also, let us observe that if f>, ft are left continuous 
with respect to a € (0,1] and right continuous at 0, considering a sequence 
hn — 0, the functions 


Pea) ee PRC ee ee 
aa 7 Wie 


are left continuous at a € (0, 1] and right continuous at 0. Also, the functions 


inf nin BETO Hest HO 


An : hn 
and ; . 
B2a hn hn 
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fulfill the same properties. A limit of a sequence of left (right) continuous 
functions is left (right) continuous. Then it follows that 


inf min{ Cal (x), (Ft) (x)}, 


. max{ (in). (x), (Ga) (x)} 


are left continuous for a € (0,1] and right continuous at 0. To check mono- 
tonicity properties we observe that for a, < a2 we have 


(tz) @). (#2) @18 > 2} < {(t7) @). (Ff) @1B > an}. 
Then 
inf min{(f;) (@), (#2) @) 
is increasing with respect to a € [0,1] and 
sup max{(J5) (2). (7) @) 
is decreasing in a € [0,1]. The condition 


min{ (f>)' (a), (F')’ (@)} < max{(f7)' (2), (F*)' @)} 


concludes the reasoning that allows us to infer that the above functions define 
a fuzzy number with 


[f(a], = jaf min{ (fz) @: (4) @b-supmaxt (fz) (45) oot , 


As a conclusion, the level sets [ i). define a fuzzy number, and so, the 


derivative f{(x) exists in the sense of the g-derivative. a 


Theorem 8.44. (Bede-Stefanini [27]) Let f : (a,b) > Re be uniformly 
level-wise gH-differentiable at xo. Then f is g-differentiable at xo and, for 
any a € [0,1], 


[fg(to)la = | LU (fgur(20))e 


Bea 


168 8 Fuzzy Analysis 


Proof. For the definition of the g-difference (Definition [5.18) we have 


[f(@o +h) Og f(@o)la = J ([f(@o + h)]a Sox [F(x0)]a), Vo € [0, 1). 
Ba 


Taking the uniform limit in the above relation we obtain 


[f,(wo)la = | L (fyu(a0)), 
Bea 
| 
We conclude with an example of a fuzzy valued function that is not gH- 
differentiable but it is g-differentiable. 


Example 8.45. Consider the fuzzy valued function f : |—2,2] > Re having 
triangular values as outputs: 


having the level sets defined by 


ee 
fi (a) = 3g tate+3) 


ia a 
ae (x) = (2 a> + ra+4—a. 


We have 


Fig. 8.1 The level sets of a fuzzy valued function 
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Fig. 8.2 The level sets of the g-derivative of a fuzzy valued function 


We observe that on the interval [—2,—1] and [1,2] intervals the function is 
gH-differentiable, namely it is Hukuhara differentiable. In the interval [—1, 1] 
it is not gH-differentiable but it is g-differentiable. The function and its g- 
derivative are represented in Figs. and[8.Q\ respectively. 


8.10 Problems 


1. Calculate the Haussdorff distance between two arbitrary triangular fuzzy 
numbers wu = (a1,b1,c1) and v = (ag,b2,c2) in a simple form. Can 
we extend this result to trapezoidal fuzzy numbers? (Numerical ex- 
amples u = (—1,1,2), v = (3,4,6) and respectively u = (1,2,3,5), 
v = (3,3,4,6). 


2. Calculate the D; distance between two arbitrary triangular fuzzy num- 
bers u = (a1,61,¢1) and v = (a2, b2,c2) in a simple form. Can we ex- 
tend this result to trapezoidal fuzzy numbers? (Numerical examples u = 
(—1,1,2), v = (3,4,6) and respectively u = (1,2,3,5), v = (3,3, 4,6). 


3. Prove the properties of the D, distance listed in Proposition [8.4] 


4. Prove the properties (i)-(iv) and (vi) of a norm of a fuzzy number in 
Proposition [8.13 


5. Show that the Hausdorff distance is linked to the generalized difference 
through the relation 
Doo(u,v) = |lu Sg ull z- 
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6. 


10. 


11. 


8 Fuzzy Analysis 


Prove that the space of continuous fuzzy-number-valued functions 
(C ({a, b]; Re), Doo) is a complete metric space and also, that it is an 
F N-type space. 


. Calculate the integral of a fuzzy function f : [a,b] > Rr, f(x) =c-g(x), 


with c € R¢ being a fuzzy constant and g(x) € R a real function possibly 
changing sign once in (a, b). 


. Calculate the strongly generalized derivative of the function f(x) = 


(1, 2,3,5)-sina, directly using the definition of this concept. 


. a) For a given continuous fuzzy-number-valued function f : [a,b] > 


Ry, prove that the function F(a) = ii f(t)dt is gH-differentiable and 
Fyn (2) = f(e), : 

b) Prove that the function G(r) = 
Goa (x) = —f(2). 


Prove that if f is a strongly generalized differentiable function as in case 
(i) or (ii) of strongly generalized differentiability over the entire interval 
[a, b] then we have 


f(t)dt is gH-differentiable and 


BoA 


b 
| fanlo)de = £0) Onn F(a). 
Prove that the function given level-wise for a € [0,1] as 
fz (2) =2e"* +0? (= SD ae) 
fi(z)= a tat (1 — a”) (e* —at+ a) 


is g-differentiable without being gH-differentiable. 


9 
Fuzzy Differential Equations 


Fuzzy differential equations (FDEs) appear as a natural way to model the 
propagation of epistemic uncertainty in a dynamical environment. There are 
several interpretations of a fuzzy differential equation. The first one histori- 
cally was based on the Hukuhara derivative introduced in Puri-Ralescu 
and studied in several papers (Wu-Song-Lee [150], Kaleva [83], Ding-Ma- 
Kandel [46], Rodriguez-Lopez {125]). This interpretation has the disadvan- 
tage that solutions of a fuzzy differential equation have always an increasing 
length of the support. This fact implies that the future behavior of a fuzzy 
dynamical system is more and more uncertain in time. This phenomenon 
does not allow the existence of periodic solutions or asymptotic phenomena. 
That is why different ideas and methods to solve fuzzy differential equations 
have been developed. One of them solves differential equations using Zadeh’s 
extension principle (Buckley-Feuring [30]), while another approach interprets 
fuzzy differential equations through differential inclusions. Differential inclu- 
sions and Fuzzy Differential Inclusions are two topics that are very interest- 
ing but they do not constitute the subject of the present work (see Diamond 
[45], Lakshmikantham-Mohapatra [98]). Recently new approaches have been 
developed based on generalized fuzzy derivatives discussed in the previous 
chapter. In the present work we will work with the interpretations based 
on Hukuhara differentiability, Zadeh’s extension principle and the strongly 
generalized differentiability concepts. 


9.1 FDEs under Hukuhara Differentiability 


In this section we consider the fuzzy initial value problem x’ = f(t, x), x(to) = 
xo € Re under Hukuhara differentiability. The function f : R x Rr> Re 
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is assumed to be continuous. The following lemma transforms the fuzzy dif- 
ferential equation into integral equations. In the present section the differ- 
entiability concept is that of Hukuhara differentiability. A fuzzy differential 
equation is written using the Hukuhara derivative. 


Lemma 9.1. For to € R, the fuzzy differential equation x’ = f (t,x), z(to) = 
xo € Re where f : R x Re- Re its continuous, is equivalent to the integral 
equation 


x(t) = xo +f f(s, x(s))ds, 


on some interval [to, ti] C R. 


Proof. Let us suppose that x is a solution of the differential equation x’ = 
f(t,x), x(to) = x29 € Re. Then by integration we get 


/ n!(s)ds = [ seetspas 


and using the result in problem [LQ] of the previous chapter we get 


x(t) © xo =| f(s, x(s))ds, 


i.e., 
x(t) = Xo +f f(s, 2(s))ds. 


Reciprocally given a solution « of the integral equation we can write 


and 


We observe that 


tth 
D [ f(s,a(s))ds,h- f(t, «) 


tth tth 
-o|f F(s.2(3))as, [ HO) 


tth 
< | w(f(t,0(t)), h)ds = h- w(F(t.2(t)), h), 
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where w(f(t, 2(t)), h) denotes the modulus of continuity of the function f(t, x(t)) 
which is a continuous as a function of t € [to, ti]. Then 


(alt +h) alt) 
tin, D (EAB EMO ¢t,2(0)) 


ee 
= lim 0 -w(f(t, (t)),h) =0 


and this implies that x is a solution of the fuzzy initial value problem x’ = 
f(t, x), x(to) = Xo. = 
In Song-Wu-Lee [150] the existence of uniqueness and solutions in this in- 
terpretation was proved. This approach is close to Pickard-Lindel6of Theo- 
rem and uses Banach fixed-point Theorem in the proof. Different approaches 
based on Arzela-Ascoli results are found in literature, but they usually fail 
on the extraction of a convergent subsequence of a bounded sequence. 

First we will show that Lipshitz functions are also bounded, following 
Lupulescu. 


Lemma 9.2. ( Lupulescu [103/) Let Ro = [to, to + p| x B(xo,q) and let us 
assume that f : Ro + Re is continuous and fulfills the Lipschitz condition 


DF (t,x), f(ty)) < L- D(a, y), V(t, x), (ty) € Ro. 
Then f is bounded, i.e., there exists M > 0 such that 
D(f(t,2),0) <M. 
Proof. We observe that 
D(f(t,x),0) < D(f(t, x), f(t, v0)) + D(F(t, 20); 0) 


The real function D(f(t, x 
exists M,with D(f(t,20),0) < Mi. We get 
D(f(t,z),0) < L- D(a,20) + Mi < Lq+M =M, 
i.e., f is bounded. 7 


Theorem 9.3. (Wu-Song-Lee [150), Lupulescu [103], Bede-Gal [27)) Let 
Ro = [to, to + p] x B(2o,p), p > 0, to € Re and f : Ro > Re be continuous 
such that the following Lipschitz condition holds: 

There exist a constant L > 0 such that 


D(f(t, x), f(t,y)) a Ds D(z, y), V(t, x), (t, y) € Ro. 
Then the Fuzzy Initial Value Problem (FIVP) 
x'(t) = f(t,), x(to) = x0, 


has a unique solution defined in an interval [to,to +k] for some k > 0. 
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Proof. Let us consider Ko = C(((to, to +p], R-) and the operator P : Ko > Ko 
defined by: 


P(ao)(t) = 0, 
t 
P(x)(t) = x0 +f f(s, x(s))ds 
to 
It is easy to see that P is well defined. By Lemma [9.2] and the Lipschitz 


condition, f is bounded and also P is bounded, 


D(P(2)(t), 20) < | D(f(s,2(s)),0)ds < M(t — to) 


where 
M= sup D(f (t,x), 0) 
(t,c)ERo 


is provided by Lemma 9.2] Let d = min {p, 4} and 
Kk, =C([to, to + dj, B(xo, 9). 
Let us consider now P: Ky > C(|to, to + dj, Rr). We have 
D(P(2)(t), 0) <4 


and so given « € Ky gives P(a) € Ky. We observe that Ky, is a complete 
metric space considered with the uniform distance, as a closed subspace of a 
complete metric space. 

Now we prove that P is a contraction. Indeed, 


D(P(a)(t), P(y)(t)) </ D(f(s,(s)), f(s, y(s))ds 


< 2L(t — to) D(«, 9). 
Now choosing k = min{d, x} and further restricting P : Kg > Ko, with 


K2 = C([to, to + k], B(xo, @)) 


we obtain that P is a contraction. From Banach’s fixed point theorem there 
exists a fixed point x, € K2 with P(x,) = 2, ie., Z is a solution of Lemma 
[9-1] Finally from Lemma[9.1] we obtain that x, is a solution of the FIVP 


x'(t) = f(t,2(t)), v(to) = 20, 


for t € [to,to + k]. The uniqueness follows from the uniqueness of the fixed 
point of P, which is a consequence of Banach’s fixed point Theorem. = 


Next we prove a characterization result. 
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Theorem 9.4. (Bede [13]) Let Ro = [to,to + p] x B(xo,p), p > 0, ao € Re 
and f : Ro > Re be continuous such that 


f(t, 2)r = lie (t, £; Up Whe Cb, & ay lr € [0, 1]. 


If 


Te (t, Ly et ide (t, Ly ae eg € (0, 1] 
are equicontinuous (Ve > 0,36 > 0 such that 


lf (2, 21) — fr (to, (20), , (#0) )| <e 


when 


(t,07 a) — (to, (#0); ,(e0)#)|| <6, 


Vr € [0,1]) and uniformly Lipschitz in the second and third argument i.e., 
there exist a constant L > 0 such that 


for any (t,x), (t,y) € Ro and for any r € [0,1]. Then the Fuzzy Initial Value 
Problem (FIVP) 


a’ (t) = f(t,2), x(to) = 2X0, 


has a unique solution defined in an interval [to,to + k] for some k > 0 and 


moreover, the unique solution is level-wise x, = [x7 , xt] characterized by the 


system of ODEs 


{ (x; ark (20.8) re (0, 1]. 


Proof. It is easy to see that the conditions of the theorem ensure by the clas- 
sical Picard-Lindeléf Theorem the existence and uniqueness of solutions for 
the given crisp system. Also, equicontinuity ensures that f(t, x) is continuous 
as a fuzzy number valued function. The uniform Lipschitz condition provides 
Lipschitz condition in Theorem[9.3Jand so the existence of the unique solution 
of the fuzzy initial value problem 


x = (by x), (to) = x0. 
Now, a Hukuhara differentiable function x(t) has level sets differentiable and 
Nd / 
(2), = [(ae) , (at) 1, 
€ [0,1]. Also, the equation x’ = f(t,x) level-wise holds so we get 
(a) = fr (ta; 2) 
: ie bi Tr Si 0 1 [ 
{uh optear at) Ted 
But this equation has a unique solution. As a conclusion we obtain that the 


unique solution of the system characterizes the unique solution of the fuzzy 
initial value problem. | 
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Fig. 9.1 Hukuhara solution of a fuzzy differential equation 


Example 9.5. Consider as an example the FIVP 
x’ = —2 + 2e7*(-1,0,1), x(0) = (—1,0, 1). 


It is easy to check that the conditions in Theorem [9.3\ and also [9.4] are met. 
Also, based on Proposition[8.36| We search for triangular solution of the form 
x = (xq ,21, 24). Then we have 


and we obtain the solution 
z(t) = (e* — 2e*, 0, 2e® —e*), t € (0,00) 


represented in Fig. [9.1] 


9.2 The Interpretation Based on Zadeh’s Extension 
Principle 


Under this interpretation, an FIVP is solved as follows: We consider the 
crisp ODE which leads to the fuzzy equation considered and solve it. Then, 
solution of the FIVP are generated by using Zadeh’s extension principle on 
the classical solution. So, we start with a classical ODE 2’ = f(t, x, a), x(to) = 
xo € R, where a € R is a parameter that appears in the given differential 
equation. Let us recall the following result concerning existence, uniqueness 
and continuous dependence on the parameters and initial value of an ODE. 
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Theorem 9.6. (see e.g. Perko [122)) Let 
f : [to, to +p] x [20 — g, 20 + q] x B(ao,r) > R 
(here - 
Brn (ao,7) = {a € R” |]a — aol] <r} CR” 


denotes a closed ball in R” with the Euclidean norm ||-||). Let us assume that 
f is Lipschitz in its second variable t.e. there exists Ly such that, 


Il f(t, x, a) _ f(t,y, @)|| <1 I|x — yl| : 


Let us further assume that f is Lipschitz in the third variable i.e., there exists 
Ly such that, 
I f(t, v,a) — f(t, 2, 6)|] < Le |la — |]. 


Then the initial value problem 
tal = f(t, %, a), x(to) = Zo, 


has a unique solution. Moreover, the unique solution depends continuously 
both on the initial condition and parameters. 


Proof. The proof can be found in e.g., Perko (we omit this proof since 
it is not involving fuzzy sets) a 


Let f : [to, to + p] x B(2o,q) x B(ao,r) > Re (here B(2o,q), B(ao,r) are 
closed balls in Rz) be the Zadeh extension of f(t, 2,a). 


Definition 9.7. Let A, Xo € Re be fuzzy numbers and f the Zadeh extension 
of f. The fuzzy initial value problem 


x! = f(t, X, A), X (to) = Xo, 


is said to have the solution X : [to,to + p| ~ Re where X is the Zadeh 
extension of the solution x : [to,to + p| > R of the classical problem a2’ = 
F(t, @, a), 2(to) = Zo. 


Based on the previous Theorem combined with Theorem [5.6] we can obtain 
the following existence and uniqueness result. 


Theorem 9.8. Let f : [to,to +p] x [to —9,20 + q| x B(ao,r). Let us assume 
that f is Lipschitz in its second variable i.e. there exists L, such that, 


lft, 2,@) — f(t,y,@)|| < Li |le — yl 
and that f is Lipschitz in the third variable i.e., there exists Lz such that, 


I F(t, x, a) — f(t, #, b)|| < Le |la — bl]. 
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Then the solution of the initial value problem 
X' = f(t,X, A), X(to) = Xo, 


interpreted as in Definition [9.7 is well defined and continuous. Moreover X 
can be defined level-wise as 


Ap = 2 (t, (Xo), Ar) = {el 0,0) |e € (Xo), € Ar}, 
where x(t,x9,a) denotes the unique solution of the 
e = ft, 2,0), 0o) = 2% 
classical problem. 
Proof. According to Theorem [9.6] the problem 
G = f(t 2.a). tig) =X 


has a unique solution 2(t,vo9,a) that depends continuously on 29,a. From 
Theorem [5.6] the Zadeh extension of x(t,xo,a) is unique, well defined and 
continuous. Let us denote it by X(t, XoA). Also, from Theorem [5.6] we get 
level-wise for r € [0,1] that 


X, = 2(t, (Xo), Ar) = {2(t, 20,4) |20 € Xo,a € A}. 


Let us consider the following very simple FIVP 


vw = —(1,2,3)-2 
{ x(0) = (1, 2,3) 


with triangular fuzzy numbers. We consider this problem under the interpre- 
tation using the extension principle. 
The solution of the problem obtained symbolically from the IVP for the 


ODE 
v’=-a-x 
x(0) = xo 


at 


with the solution 
x(t) = aoe 


Using Zadeh’s extension principle we obtain the fuzzy solution 
w(t) = (1,2, 3)e9)F, 


which can be written level-wise as 


which exists for t € [0, 1]. 
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Fig. 9.2 Zadeh extension based solution of a fuzzy differential equation 


9.3 Fuzzy Differential Equations under Strongly 
Generalized Differentiability 


9.3.1 Existence and Uniqueness of Two Solutions 


Fuzzy differential equations under generalized differentiability were investi- 
gated first in Bede-Gal [20]. Later more general results were proposed in 
Bede-Gal i]. Under strongly generalized differentiability there is a new be- 
havior that emerges in the theory of differential equations in abstract space, 
namely that of the existence and local uniqueness of two solutions and that 
of switching. These very interesting phenomena are under investigation by 
many authors (Bede-Rudas-Gal [25], Chalco-Cano-Roman-Flores [36], Mali- 
nowski [106], Lupulescu etc.) Other interesting research topics include 
the topics of Semigroups of operators on FN-type spaces (Gal-Gal [71], Gal- 
Gal-Guerekata [72], Kaleva [85]) 
We need one lemma: 


Lemma 9.9. (Bede-Gal, [2i)) Let x € Re be such that the functions x, = 
[x , xt], r € (0, ljare differentiable, with x~ strictly increasing and x* strictly 
decreasing on [0,1], such that there exist the constants cy > 0, cz < 0 satis- 
fying (az) > ex and (at)! < cg for all a € [0,1]. 

Let f : [a,b] > Re be continuous with respect to t, having the level sets 
fa(t) and ft(t) with bounded partial derivatives Shao) and af with re- 
spect to a € (0, 1], t € [a, dB. 
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b) a7 =a} and the core [f(s)]1 consists of exactly one element for any 
s €T =[a,}], then there exists h > a such that the H-difference 


ref f(s)as 


exists for any t € [a, hl. 


Proof. We observe that the H-difference of two fuzzy numbers u 6 v exists if 
and only if the functions (u~ — v~,u* — v*) define a fuzzy number. Indeed, 
let us suppose that u © v = 2z, this is equivalent to z+ v =u and taking the 
a-levels we have equivalently 


[za 22] + [vy et] = lug, ull, 
Le., 
zy = Ug Us 4 
a =u —vt, 


a € [0,1]. By Theorem [4.10] the assumption that u © v exists is equivalent 
with the fact that (w= —v~,u* —v7) define a fuzzy number. Moreover, since 
left and right continuity requirements of Theorem obviously hold true 
whenever u,v are fuzzy numbers, the existence of u G v becomes equivalent 
to 


Vy 


i 
T 
—vUy Sup -uy,, 


and that u~ — v~ is non-decreasing and ut — v* is non-increasing. 
Therefore, in order to prove the existence of 76 i f(s)ds in the statement, 
we have to check that 


[[ ros] — [f° soos] <2t ~27 =tenlan), 


t 
La — if F(s)ds| is nondecreasing w.r.t. a, 


t 
xt — | F(s)ds| is nonincreasing w.r.t. a. 
a 


if F(s)as| =|) “fr (s)ds, [ : Feds} 


which implies that the above conditions are equivalent to 


/ len([f(s)]1)ds < len({x]1), 
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age 
fae) -f Pha) 4. > 0, for all a € [0,1] 


a 


Oa 


(zt) — [ee Ofals Ofa (8) a6 <0, for all a € [0,1]. 


Since f is continuous, it is bounded and the function len[f(t)]1 is bounded 
as well. Let M be such that 


len[f(t)]1 < M,t € [a,b]. 


Also, note that we always have 


‘| len|f(s)]1ds < M(t— a). 


Suppose we are under assumption a) in statement. Then, since for all t € 
[a,a + len([2]1)/M], we get 


M(t — a) < len([z]1), 
by the above inequality it easily follows that 
t 
/ len([f(s)]1)ds < len([a}1). 


Let M,, Mz > 0 be such that 


and 


< M2, 
a 


| Ofa (8) 


for all s € [a,b] and a € [0,1]. Since (xz) > c; for all a € [0,1], we have 


t = 
6) 
} Fe (S) 4 < (t — a)M, < Cl < (xz)’ 
a Oa 
for any t € la,at “| and for all a € [0,1], which implies that x 7 — 
f fi (s)ds is non-decreasing with respect to a for t € [a. a+-< tt]. Similarly, 


since (a1)' < cp for all a € [0,1] we have have 


as “eh ag < (t—a)Mp < |ea| < — (x2) 


a 


182 9 Fuzzy Differential Equations 


and for any t € [a, a+ Hell and for all a € [0,1], ie. av -fi f2(s)ds is 


non-increasing with respect to a. 
By the above reasoning it follows that «© { f(s)ds exists, for all t € [a, Al, 


va leal len({x]1) 
ae at Cy |C2 en 1 
h = min ez Mi,’ Mp’ —r1T \ > 0. 


If we are under the assumption b), then it follows that len([f(s)]1) = 0, for 
all s € [a,b] and 


[ len([f(s)]1)ds = len([z]1) = 0, 


for allt € [a, 6]. The other two required inequalities can be obtained by similar 


reasoning as above, for all t € [a,a+h], where h = min { A Lal} > 0, which 


proves the lemma. = 
The following result concerns the existence and uniqueness of solutions of a 
fuzzy differential equation under generalized differentiability. 


Theorem 9.10. (Bede-Gal [20), Bede-Gal [27J)Let Ro = [to, to+p| x B(xo, q), 
p,qg > 0, to € Re and f : Ro > Re be continuous such that the following 
assumptions hold: 

(i) There exists a constant L > 0 such that 


D(f(t, 2), Flt, y)) <L- D(z, y), V(t, z), (t,y) € Ro. 


(ii) Let [f(t,x)Ja = [fa (t,x), ft (t,x)] be the level set representation of 
f, then fx, ft : Ro 4 R have bounded partial derivatives with respect to 
a € [0,1], the bounds being independent of (t,x) € Ro and a € (0,1). 

(iii) The functions xy and xq are differentiable (as functions of a and 
there exist c; > 0 with (xo), > ci, and there exists co < 0 with (ao)* <2, 
for all a € [0,1] and we have the possibilities 

a) ey 2a 

or 

b) if ay = af then the core [f(t,x)]1 consists in exactly one element for 
any (t,x) € Ro, whenever [a], consist in exactly one element. 

Then the fuzzy initial value problem 


x'(t) = f(t, 2), 2(to) = xo, 
has exactly two solutions defined in an interval [to, to + k] for some k > 0. 


Proof. We use Lemma [9.2] together with the previous Lemma [9.9] The ex- 
istence result in Theorem [9.3] ensures the existence of one solution which 
is Hukuhara differentiable. Here we will prove the existence of the other 
solution. 
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First, let us observe that assumptions (ii) and (iii), by Lemma/[9.9] ensure 
the existence of the H-difference 


29 0 (- i “Pltse(0)at) 


for t € [to,to +c] for some 0 < c < p. Now we consider R, = [to,to +c] x 


B(xo,q), Ko = C([to, to+c], Rx) and the operator Q : Ko > Ko (C({a, b], Re) 
being the space of continuous functions x : [a,b] > Rz) defined as follows: 


Q(xo)(t) = xo 


Q(z)(t) = 20 8 (- [ Ft-2@at) 


to 


We observe that Q is well defined on [to, to +c] by the choice of c. By Lemma 
[9.2] and the Lipschitz condition (i) of the present Theorem, f is bounded and 
we have 


D(Q(«)(t), 0) < i D(f(t,x()),0)dt < M(t — to), 


where M = supy.jer, D(f(t,£),0) is provided by Lemma Let d = 


min {c, oy and 
K, = C((to, to + dj, B(x, q)). 


Then for the restriction Q : kK, > C([to, to + dj, RF), we have 


D(Q(x)(t), #0) S 4, 


Le, « € Ky gives Q(x) € Ki, and Ky is a complete metric space considered 
with the uniform distance, as a closed subspace of a complete metric space. 
Now we will show that Q is a contraction. Indeed, 


D(Q(x)(t), Q(y)(t)) < | D(F(t,x(t)), F(t, y(t) )at 


< 2L(t — to) D(a, y). 


Now choosing k < min{d, sh}. Q becomes a contractions. Banach’s fixed 
point theorem implies the existence of a fixed point of Q. To conclude, we 
observe that the fixed point of @ is strongly generalized differentiable as in 
case (ii) of Definition [8.31] and it solves the fuzzy initial value problem 


a’ (t) = f(t, x), x(to) = XO, 


for any t € [to,to + k]. The local uniqueness of this solution on [to,to + k] 
follows by the uniqueness of the fixed point for Q. = 
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9.3.2. Characterization Results 


We will extend in this section the Characterization result of Theorem [9.4] to 
the case of generalized differentiability. 


Theorem 9.11. (Bede [13], Bede-Gal [20]) Let Ro = [to, to +p] x B(xo, 4), 
p>O0, to € Re and f : Ro — Re be such that 


[f(t, )]a = es (Gast pie Ce 8) Re € [0, 1] 


and the following assumptions hold: 
(i) fF(t,aQ,22) are equicontinuous, uniformly Lipschitz in their second 
and third arguments i.e., there exist a constant L > 0 such that 


far (tt5.0a) — fa (ts Ya¥a)| S Lea — yal + lea — yal), 
V(t, x), (t,y) € Ro, a € [0,1]. 

(ii) fo, ft : Ro — R have bounded partial derivatives with respect to 
a € [0,1], the bounds being independent of (t,x) € Ro and a € (0,1). 

(iii) The functions x, and x, are differentiable, existing c, > 0 with 
(xo), > c1, and cz < 0 with (ao)* < co, for all a € [0,1], and we have the 
following possibilities 

a) (wo), < (ao), 


or 
b) if (ao), = (ao)? then the core [(t, x, u)]1 consists in exactly one element 

for any (t,2) € Ro, whenever [x], and [ul], consist in exactly one element. 
Then the fuzzy initial value problem 


at) = f(t, x), (to) = X0,; (9.1) 
is equivalent on some interval [to, to + k] with the union of the following two 
ODEs: ; 

(za) () = fa (426 0), 22 (t)) 
(el) =(siheg eG) yore (01) (9.2) 
az (to) = (@0),, .@t (to) = (ao), 
(ea) (t) = fo (t, ra (t), v9 (t)) 
(wa) () = fa (420 (),27a (9) ,a € [0, 1]. (9.3) 
+ 


xq (to) = (®o)q »€4 (to) = (to) a 
Proof. Condition (i) of the theorem ensures the existence of a unique solu- 
tion for each of the systems of equations (9.2), (9.3) for any fixed a € [0,1]. 
Let us denote these solutions by (x, )’ ,(%)’ and (az )" , (az) respectively. 
The equicontinuity of f= ensures the continuity of f as a fuzzy valued func- 
tion, while the Lipschitz condition in (i) is sufficient for the corresponding 
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Lipschitz property of f. All these conditions together ensure the existence 
and uniqueness of two solutions x’ and x” for the fuzzy initial value problem 


(ZI). Let [2], = [(2*)_, (x*) 7] ard: |") = [(wt*)~ , (wi#)*), a € [0,1]. 


Then, since x? Hukuhara differentiable then 


and (2') @. is a solution of the system (@2). Since (xz)',(x%)" is the 
unique solution of the system we obtain 


((@)Z (@)2) = (wa) (@d)") Vo € 10, 11 


Similar reasoning for the (ii)-differentiable solution implies 


ey]. = [((@*)Z) ((2*)2) 


SO (x**)* ,(a") is a solution of the second system (9.3) considered in the 
Theorem, so 


((o")o sa") = (Cea) (@a)") Ye [0,1 


As a conclusion the solutions of the initial value problem (9.1) are exactly 
those of the given systems (9.2) and (9.3). fi) 


In the followings we formulate a particularization of the existence, uniqueness 
and characterization Theorem[9.11]for fuzzy initial value problems with trian- 
gular data. We denote by Ry the space of triangular fuzzy 
numbers. 


Theorem 9.12. Let Ro = [to,to+p] x (B(xo,p) NRr) , p > 0, 2 € Rr and 
f: Ro > Rr be such that 


iG x) = (F-( a ee ett, ae, a aa" )) 


and the following assumptions hold: 

(i) f-,f*,f* are continuous, Lipschitz in their second through last 
arguments. 

(ii) xo = (ap ,2b,24) is a nontrivial triangular number such that xp < 
ah <a. Then 

(a) The fuzzy initial value problem 


x'(t) = f(t,«), (to) = 20, (9.4) 


has exactly two triangular valued solutions on some interval [to, to + ki]. 
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(b) Problem is equivalent to the union of the following two ODEs: 
(a7) = f-(t,07, a, at) 
(21) = Pt,7,a1,e*) 


(@tY=fttejaet) a 
“-()= 2552 Co) = 2h." to) = 2 

i) =f'Gee 07) 

(ay, = HG ae) 

(ty =feaet) 


oto) Hg oe te) He SH 


Proof. It is easy to check that since f is triangular valued, the solutions of 
(@4) are triangular valued. Further the conditions (i) and (ii) ensure that 
the problem has two unique solutions locally. It is easy to check that 
the conditions in Theorem are fulfilled and the problems and (9.3), 
in the case of triangular-valued functions are equivalent with (9.5) and (9.6) 
respectively, and the proof is complete. = 


9.3.3 Examples of Fuzzy Differential Equations 
under Strongly Generalized Differentiability 


In what follows we solve several fuzzy differential equations under generalized 
differentiability. 


Example 9.13. Let us begin with the homogeneous decay equation 
xg’ =—x, «(0) = (-1,0,1). 


Surely since (i)-differentiability is in fact Hukuhara differentiability we obtain 
the solution x(t) = e'(—1,0,1). Under (ii)-differentiability condition we get 
the solution x(t) = e~'(—1,0,1). The behaviors of the two solutions differ 
substantially, as shown in Fig. [9.31 


Example 9.14. By adding a forcing term we obtain the following equation 
(see Tenali-Lakshmikantham-Devi and Bede-Tenali-Lakshmikantham [26J) 
zg =—2+e *(-1,0,1). 


Let us keep the initial condition the same as in the previous problem, 1.e. 
xo = (—1,0,1) under strongly generalized differentiability cases (i) or (ii). 
For the case of Hukuhara or (i)-differentiability we get 


(29 )’ =~ aye" 
Ly =—-1 
(xq) =-z +e" 


and it has the solution x(t) 


I 
— 
Nik 

Oo 
| 
+ 
| 
vl 
o 
ce 
=) 
NI 
o 

| 
NI 

ia) 

us 
— 


9.3 Fuzzy Differential Equations 187 


Fig. 9.3 Two solutions of a fuzzy differential equation (solid line is (i) differentiable 
solution, dash-dot line is the (ii) differentiable solution 


Under (ii)-differentiability, the fuzzy differential equation becomes 


(x9 )' = —2p +e 
x =—-Z 
(ag) = —ag —e* 


and we get a(t) = e~*(1 — t)(—1,0,1). In Fig{[¥-4] the (i)-differentiable and 
(ii)-differentiable solutions are presented. 


Example 9.15. This example was proposed in Bede-Gal [2i/. In Barros- 
Bassanezi and Nieto-Rodriguez-Lopez a logistic fuzzy model is ana- 
lyzed in detail and the findings are that it is an adequate model for population 
dynamics under uncertainty. We use the strongly generalized differentiability 
and the results on characterization previously discussed to analyze a fuzzy 
logistic equation 


a =an(K Ogy x), a(0) = 2 


where aKzx is the growth rate, ax? is the inhibition term and K is the en- 
vironment capacity. The generalized Hukuhara difference K Ogy x is used 
here. The advantage of this difference over the Hukuhara difference in this 
example is that the generalized Hukuhara difference exists in situations when 
the usual Hukuhara difference fails to exist. We consider a, kK € Ry sym- 
metric triangular numbers and xo, kK € R. We use in our example xp = 


500, a = (0.98, 1, 1.02)- 10-8, K = (9,10,11)- 10%. Let us remark that the 
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Fig. 9.4 Two solutions of a fuzzy differential equation (solid line is (i) differentiable 
solution, dash-dot line is the (ii) differentiable solution 


function f(t, 2) = ax(K 6,2) is not a triangular-number-valued function even 
if the inputs are triangular numbers, since the product of two triangular fuzzy 
numbers is not generally triangular. In this case we have for any a € (0, 1], 


ee (x a =a, ae {ta (he aa yes [Ai -a)t 
ae|0, 

Pao e )=an Ul =a) 

Pe »m, 27) = al velo] {xa (Ke = Hq) 1% (Ka —ay)}. 
ae |0, 


These are piecewise quadratic functions of a and the more general character- 
ization result is necessarily used. Locally, the FIVP is equivalent to the 
problem 


(xz) ~~ Fe te 50 sa") 
@l)=FiGe a2") (9.7) 


a (to) = 29 ,2'(to) = 29, 2* (to) = xy 

It is easy to see that the only solution we have locally on some interval [0, p] 
is the solution according to case (i) of differentiability, since xo € R. Let p= 
inf{t > 0: a5 (t) (KZ — ag (t)) = at (t{)(KE — at (t))}. We have numerically 
obtained p = 0.407. We observe that if we use now p and xp = x(p) as initial 
values for a new initial value problem 


wv! = ax(K Ogu 2), 2(p) = Xo 
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Fig. 9.5 Two solutions of a fuzzy differential equation 


two solutions will emerge according to Theorem |9.10| characterized by the 


systems (9.7) and (9.8), 


(G27 252") é (9.8) 
eg \= 25 0 Co) = oh. 2 ho) = ae 


One is differentiable as in (i) and another differentiable as in (ii) case of Def- 
inition[8.31) Let us remark also, that we can paste together the solutions and 
we obtain two solutions on the [0,1] interval. We can see that the most real- 
istic model appears to be the one which starts with case (i) of differentiability 
on [0, p| and continues with case (ii) of differentiability on [p, 1]. The solution 
which is (i) differentiable is the Hukuhara solution on [0,1] and it is unreal- 
istic from practical point of view since the population may increase according 
to that solution much more than the environment’s capacity. In Figure [9.5 
these solutions are shown, where x’ represents the lower and upper endpoints 
of the 0-level set of the solution according to case (i) of differentiability, x 
is the O level set of the solution as in case (ii) of differentiability. xlis the 
common 1-level set of the two solutions. 

This example also allows us to underline the practical superiority of the 
strongly generalized differentiability with respect to the Hukuhara derivative 
case. Several other practical examples were proposed in the literature. 


9.4 Problems 


1. Solve the fuzzy differential equations 


x’ =2,2(0) = 29 
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x’ = —2x,2x(0) = 29 


under Hukuhara differentiability, for arbitrary trapezoidal fuzzy initial 
value x9 € Re xo = (a,b,c, d). 


2. Solve the fuzzy differential equations 


x’ =2,2(0) = 29 


uv = —2,2(0) = x09 


using Zadeh’s extension principle-based method, for arbitrary trapezoidal 
fuzzy initial value 2p € Re xo = (a,b,c, d). 


3. Solve the fuzzy differential equations 


x =2,2(0) = 29 


oS =9,4(0) = 


under generalized differentiability, for arbitrary trapezoidal fuzzy initial 
value 2p € Re xo = (a,b,c, d). 


4. Using Zadeh extension principle-based approach solve the fuzzy differen- 
tial equation 


xv’ =a:-2+b,x(0) = 29 


under strongly generalized differentiability with a € R, b,a9 € Rr, b= 
(b-,b!, b+), zo = (xq, x, a0) triangular fuzzy numbers. 


5. Solve the fuzzy differential equation 
xv’ =a-2+b,x(0) = 29 


under strongly generalized differentiability with a € R, b,a9 € Rr, b= 
(b—,b',b*), zo = (xp , 24, 2G) triangular fuzzy numbers. 
Try to consider a generalization to a triangular number a=(a~,a',a*), 
with a restriction to the case when a~ > 0 and 2 > 0. 


6. State and prove a more general version of the Characterization result in 
Theorem[9.1]] for a system of fuzzy differential equations and respectively 
for a second order fuzzy differential equation. 
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7. Consider a first order linear differential equation 


y' =a(x)- y+ W(x), y(xo) = Yo 


with a(x) real valued function, and b: R > R-z. Prove that 


inte) = ef" (yo +f 


b(t) e~ Fe0 aos) (9.9) 


(0) 


and 


inte) = ef (yoo [oye Fo"Mar), (9.10 


0 


a(u)du 


provided that the H-difference yo © Jo, (bo) -e Seo dt exists, are 


solutions of the fuzzy differential equation y’ = a(x) - y+ b(2). 


8. Describe Euler’s method to calculate the solution of a fuzzy differential 
equation using the characterization theorem presented in this chapter. 


10 
Extensions of Fuzzy Set Theory 


In fuzzy set theory the membership function of a fuzzy set is a classical 
function A : X — [0,1]. In some applications the shape of the member- 
ship function is itself uncertain. This problem appears mainly because of 
the subjectivity of expert knowledge and imprecision of our models. In these 
situations we can use a higher order extension of fuzzy set theory. 


10.1 Lattice Valued Fuzzy Sets (L-Fuzzy Sets) 


Definition 10.1. Let (L,<), be a complete lattice (t.e., any non-empty subset 
of L has an infimum and a supremum). A negation on a complete lattice is 
an operator N: L + L such that N is involutive, i.e. 


N(N(a)) = 2, Va € L, 


and non-increasing, i.e., if «<y then N(x) > N(y), 2, y € L. 
In the followings we assume that L is a complete lattice with a negation. 


Definition 10.2. (Goguen [73]) An L-fuzzy set on the universe X is a map- 
ping A: X + L. The class of L-fuzzy sets is denoted by F,(X). The oper- 
ations on L-fuzzy sets are point-wise provided by the inf and sup that come 
from the lattice structure. The basic connectives of L-fussy sets are 


A B(a) = inf(A(zx), B(z)), 


AV B(x) = sup(A(z), B(2)), 
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for anyxEe X. 


In general, for L-fuzzy sets distributivity does not hold. In order to be able 
to use this property we need to have a distributive lattice i-e., such that the 
sup is distributive w.r.t. inf and vice versa 


aV (bAc) = (av b) A(aVc) 


and 
aN (bVc)=(aAb)V (ac). 


Also, in some problems complete distributivity could be required i.e., 


aV (A») = \\avb, and aA (V+) =\Janb,. 


wel ier ier ier 


If L is a distributive (completely distributive) lattice, then the L-fuzzy set 
operations become distributive (completely distributive). 


Example 10.3. ((0,1],<) is a completely distributive lattice. Then classical 
fuzzy sets can be seen as L-fuzzy sets with L = [0,1]. We observe that (0, 1] is 
complete and completely distributive lattice. We observe that the L-fuzzy sets 
with L = [0,1] coincide with the fuzzy sets F(X). 


Example 10.4. (F(X),<) the family of fuzzy sets over the same universe 
of discourse X with the inclusion. Then F(X) is a lattice. The infimum is 
the fuzzy intersection \, while the supremum will be the fuzzy union V. We 
can now use L = F(X) as a lattice to define L-fuzzy sets. Surely iteration on 
this procedure is possible. 


10.2 Intuitionistic Fuzzy Sets 


Definition 10.5. (Atanassov [6)) Let X be a non-empty set. An intuitionistic 
fuzzy set is a pair of mappings A = ("a,va) : X — [0,1] that fulfill the 
condition 


baAtv,s <1,VrE X. 
La represents the degree of membership while va is the degree of non- 
membership. 


Remark 10.6. A fuzzy set wa can be interpreted as the intuitionistic fuzzy 
set A = (wa,1— pa). The reciprocal is not necessarily true. 


10.3 Interval Type II Fuzzy Sets 195 


The basic operations between intuitionistic fuzzy sets are defined as follows: 

AN B = (min(14, we), max(v4,Vz)) 

AUB = (max(j14, WB), min(va4, VB)) 

N(A) = (va, Ha). 

We denote the collection of all Intuitionistic fuzzy sets by IF'S(X). Intuition- 
istic fuzzy sets were studied by several authors (e.g. Szmidt-Kacprzyk [143], 
Ban [7) and they were used successfully in applications (Sussner et. al. 
etc.) 


Proposition 10.7. The set IF S(X) with the operations of union intersec- 
tion and complement defined as above is a distributive lattice. Moreover it is 
complete and completely distributive. 


Proof. The proof is immediate. = 


Remark 10.8. Intuitionistic fuzzy sets can be seen as L-fuzzy sets by con- 
sidering the lattice L C [0,1], 


L={(a,y) € [0,1P|e+y< 1} 
where the inequality relation generating the Lattice structure is defined by 
(2,9) <2 (2,1) @ |e s 2 ond y > il. 


Moreover, L in this case is a complete, completely distributive lattice. 


10.3. Interval Type II Fuzzy Sets 


Let [0,1] denote the set of closed sub-intervals of [0, 1]. 


Definition 10.9. (see e.g. Mendel, [110]) An interval valued fuzzy set is a 
mapping A: X — I[0,1]. Let us denote 


A(x) = [A(2), A(2)]. 


Then A(x), A(x) can be interpreted as the lower and upper bounds of the 
membership grade. 


Operations with interval valued fuzzy sets are defined by: 
AU B(2) = [sup{A(zx), B(z)}, sup{ A(z), B(x)}}] 
AN B(a) = [inf{A(x), B(x)}, inf{ A(x), B(z)}] 


NA(zx) = [1 — A(z), 1— A(2)]. 
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If A = (#44, V4) is an intuitionistic fuzzy set then we define an interval valued 
fuzzy set, A(x) = wa(x) and A(x) = 1 — va(x). Then we have a correspon- 
dence between interval valued fuzzy sets and intuitionistic fuzzy sets because 
we can reciprocally consider a(x) = A(x) and v4(x) = 1 — A(z). 

This correspondence is well defined since 


= va(x) <1— pa(z) 
> pa(x) + va(a) <1. 


Proposition 10.10. The set of interval valued fuzzy sets with the operations 
of union intersection and complement defined as above is a distributive lattice. 
Moreover it is complete and completely distributive. 


Proof. The proof is a direct consequence of the above discussion with Propo- 
sition [10.7 a 


Remark 10.11. Interval valued fuzzy sets can be seen as L-fuzzy sets, by 
considering the complete distributive lattice L = I[0,1] with the inequality 
defined as 

[a,b] < [ed] S@a<candb<d. 


10.4 Fuzzy Sets of Type 2 


Type m fuzzy sets can be defined recursively as follows. 


Definition 10.12. (see e.g. Mendel, [110]) Type 1 fuzzy sets are regular 
fuzzy sets 
Fi(X) ={A: xX => [0,1]}. 


Type m fuzzy sets, m > 1 are L-fuzzy sets whose membership degrees are type 
m—1 fuzzy sets 


Fim(X) = {A:X 4 Fm_1([0,1])},m > 2. 


Type 2 fuzzy sets are the most important cases of type m fuzzy sets. They 
are characterized by membership function p4 : X + F[0, 1]. 


pa(a)(u) € [0,1], 


Va € X and u € (0, 1]. 
For a given « € X we denote by J, the support of p14(2), ie., 


Jn = {u: |p(a)(u) A OF. 
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The notations used for fuzzy sets of type 2 are as follows 


A= {(a,u,H4(@,u))|a € X,u€ Ix}, 


ae i 1 yg (a,)/(e,4), Je € (0, 1), 
rTeEX,ucTy 
or 


Ala) = / nee: C10. 
uc Jy 


where the integral sign denotes union over all admissible values. 

There is a strong connection between fuzzy sets of type 2 and interval 
valued fuzzy sets. Namely, if we consider a fuzzy set of type 2 A then its 
footprint of uncertainty is defined as 


FOU(A) = |) Je. 


We can determine two type 1 fuzzy sets 


w,(2) = J, = inf Jz, iz(x) = Je = sup Jo. 


Now we define I, = [J,, J], and in this way we have obtained an interval 
valued fuzzy set B: X — I[0,1], B(x) = Ip. 

As a conclusion from a type 2 fuzzy set we can obtain an interval valued 
fuzzy set. The reciprocal is not true, i.e. from an interval valued fuzzy set we 
cannot obtain the type 2 fuzzy set that was initially considered. This shows 
that type 2 fuzzy sets are more general than interval valued fuzzy sets or 
intuitionistic fuzzy sets. 

The operations between interval type 2 fuzzy sets can be directly defined 
as follows. 


— 


U B(a)(u) = wale,u) V ng(@,u) 


— 


N B(a)(u) = nale,u) A ng (@,u) 


N(A)(a)(u) = 1— p4(2,u). 


These operations do not have some desirable properties and interpretation. 
For example they do not satisfy Zadeh’s extension principle. Different opera- 
tions are introduced and studied in the literature, based on Zadeh’s extension 
principle as follows: 


AV B(«)(u) = sup{min(u 4 (2, v), wg (a, w))| max(v, w) = u} 
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AA B(a)(u) = sup{min(u 4 (a, v), wa (a, w))| min(v, w) = u} 


N(A)(@)(u) = 1— g(a, u). 


10.5 Problems 


1. Prove that the operations defined on intuitionistic fuzzy sets verify De 
Morgan laws: 
N(AV B) = N(A)A N(B) 


2. Consider the following intuitionistic fuzzy set 
A(x) = (wa(x), va(@)), 
where a(x) = (7,8,9) and 


1 sif x<6 
a) BSE EGS eS 
valt)=) 278 if gca<10 
0 if W<a 


Verify that the membership functions considered are defining indeed an 
intuitionistic fuzzy set. 

3. Prove that L = I[0,1] with the inequality defined as [a,b] < [c,d] <=> 
a< cand b < dis a lattice. Find the supremum and infimum of two 
intervals [0.2, 0.5], [0.3, 0.6]. 


4. Consider the following interval valued fuzzy sets A(x) = [A(z), A(ax)| and 
B(x) = (B(x), B(x)] where 
0 if C< 2 
a-2 if 2<a<38 


Ala) = 4—-g if 3<2<4"’ 
0 if 4<2 
0 if ge 1 
x—1 7 
re _ =e if loe<3 
A) SY eee it 23 2G 
0 if 5<a@ 
0 if r<4 
e—-4 if 4<a<5 
BOSS ge Ab Re ae OF 


0 if 6<2 
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0 if z<3 
- a if 3a a<5 
_ es = 
B@)=". a. Gt pepe 
0 if 7<2 
Verify that the given membership degrees define an interval valued fuzzy 
set by sketching the membership functions. Calculate A A B and AV B 
and graph them. 


5. Given interval valued fuzzy sets A(x) = [A(x),A(x)] and B(x) = 


(B(x), B(«)] with 


A(z) = 4-—ax if 3<a<4’ 
0 if 4<a 
0 if xr<l 
a—1 
7a _ =z if 1<a¢<3 
Alt)=9 st if 3<2<5 
0 if 5<2 
and 
0 if «<20 
220 if 200<2< 30 
-_ 0 1 = 
Bir)=) se if 30<2< 40 ’ 
0 if 40<2 
0 if 2«<10 
: 2-10 if 10<2<30 
— 10) _ 
Bt)=) séex if 39 <2 <50 


if 50 <2 
we consider the fuzzy rule 
if zis A then y is B 


with a Mamdani inference system. Given the crisp input x = 2.5 find 
the firing level (interval) for the given fuzzy rule. Sketch the graph of the 
output of the inference system. 


6. Prove Proposition [10.7] 


11 
Possibility ‘Theory 


11.1 Fuzzy Sets and Possibility Distributions 


Let X be a set, adopted as the universe of discourse in what follows. We ask 
the question whether a value for a variable is possible. The answer will be a 
fuzzy set when the problem we are considering has uncertainties that are not 
of statistical type. 


Definition 11.1. (Dubois-Prade [51)) A possibility distribution m of a fuzzy 
variable x on a set of possible situations X is a fuzzy set 7: X — [0,1], such 
that there exists an x9 © X such that m(ao) = 1. 


A possibility distribution aims to distinguish between what is expected and 
what is surprising, with the following convention 7(u) = 0 means that « = u 
is rejected as impossible, 7(u) = 1 is totally possible, while 7(u) = 0.7 means 
that it is possible with the degree 0.7. So, 7(u) means the degree of possibility 
of the assignment xz = u, some values u being more possible. 

Now we can ask the question: If we consider a crisp set of values A C 
X what is the possibility degree of x € A. Also, a related question is the 
following: Does x necessarily belong to A? 


Definition 11.2. (Dubois-Prade [51/) The possibility degree of x to belong 
to A is 
II(A) = sup 7(2). 
rEA 
The necessity degree is 
N(A) = inf, n(n(A)), 


where n is the standard negation. 
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The mathematical theory for possibility distributions is Fuzzy Measure 
Theory. 


11.2 Fuzzy Measures 


Definition 11.3. (Sugeno-Murofushi [139]) Let yu be a function from a o— 
algebra B C P(X) to [0,1]. uw is a fuzzy measure if 

(i) 10) = 0,u(X) = 1 

(ii) For any A,B € B we have p(A) < p(B). 

(iit) If {Aj }iai,2,... C B is an ascending (respectively descending) mono- 
tone sequence Ay C Ag ©... C An C... (respectively Ay D Ag D... D An D 
...) then 


prea ttn) = WED, Ans 
where limn—+oo An = US An (respectively limn+oo An = NPL) An) 


Proposition 11.4. (Gal-Ban [70])For a fuzzy measure we have 
(i) u(AU B) > max(yi(A), u(B) 
(ii) (AN B) < min(y(A), p(B) 


Proof. Since 


ANBCACAUB 
ANBCBCAUB 


from the monotonicity of g the statement easily follows. a 


Example 11.5. Probability measures are fuzzy measures. The additional 
property that they have is that of c—additivity 


P (U«) = SPA), 
i=1 i=1 
where A; A; = when i Fj. 
Example 11.6. Dirac measure 


wa) = { 1 if wE€A 


0 otherwise 


where x9 € X is fixed, is a fuzzy measure. 
Definition 11.7. (Gal-Ban [70J) A set function gy : B — [0,1] that fulfills 
(i) 9(X) =1 
(it) 
ga(AU B) = gy(A) + ga(B) + A+ ga(A) + ga(B) 
with AN B= , is called a Sugeno \—measure. 
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Remark 11.8. Jf 1 =0 then a Sugeno A—measure becomes a classical mea- 
sure. 


Lemma 11.9. If B; are disjoint sets and \ £0 then 
lee) 1 Co 
gr (U a, =s Tle + Agy(Bi)) — J . 
Proof. The relation 
nm 1 n 
ON (U a == Tre + Ag (Bi)) — J ; 


with arbitrary n > 1 can be proved by induction. By taking the limit as 
n — oo we obtain the relation in the statement of the Lemma. a 


Lemma 11.10. [fg ts a A—fuzzy measure then 


- 1—g)(A) 
A) = —————_.. 
9n(A) 1+ Xg)(A) 
Proof. The proof is left to the reader as an exercise. = 


Proposition 11.11. (Gal-Ban [70]) A Sugeno \—measure is a fuzzy measure 
for’ >-1. 


Proof. (i) We have 
ga(X UD) = ga(X) + ga(O) + Aga (X) 9 (0). 


Since g,(X) = 1 we get g,(0)(1 + A) = 0 and then g)(0) = 0, since A > —1. 
(ii) Let A C B. Then there exist C = B\ A with AUC = Band ANC = 0. 
Then 


gn(B) = g\(AUC) = gy(A) + ga(C) + Aga (A)ga(C) 
= g (A) + (1 + Agy(A))9a(C) = ga(A). 


(iii) Let Ay C Ap C ... C Ay, C ... be an ascending sequence. Let By = 
Aj, Bo = Ag \ By,..., Bn = An \ Bye}, ss Then B; NM B; = 0,1 x j and 
n=iAn = U1 Bn. 
Taking into account Lemma [I1.9] we obtain 
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On the other hand since A, = U?_, Bj we obtain 


Comparing the two relations above we get 
ga( lim A,) = lim g)(A,), 
noo noo 


ie., the continuity by ascending sequences. 

For the continuity by descending sequences we consider A, D Ag D ... D 
An > .... Then the complements A, C Ay ©... C An C... form an ascending 
sequence. Taking into account Lemma[IL.10] we get 


ry 
1+ Agy ( U An) 
n=1 
Taking into account the continuity by ascending sequences we get 


: 7 1 —limn-+o0 9a (An) 
ea aa URE 


_ 1=gy (An) 
= lim ———.. 
neteo T+ -Agn (An) 


Using Lemma [I1.10) finally we obtain 


_ say 
: : 1+Ag, (An 
gx lim An) = lim > ak toa (An) 
noo noo J 4 ATE ee 
~ le (TFA) wet MAN): 


Proposition 11.12. Let A,B € B not necessarily disjoint. Then we have 


gn(A) + gx(B) — g\(AN B) + A+ 9(A) + 9gy(B) 


ee 1+ 9(AnB) 


Proof. The proof is left as an exercise to the reader. | 
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Definition 11.13. (Dubois-Prade [51/) A possibility measure is a set func- 
tion II: B > [0,1] such that 


(i) 10) = 0, W(x) =1 
(ii) If {A;|t € I} C B then 


n(Ua) = supII(Ai). 


tel 


Definition 11.14. A possibility distribution is a fuzzy set m : X — [0,1] 
such that there exists xo € X with r(x) = 1. 


Proposition 11.15. Given a possibility distribution 7, for any A © B we 
define II(A) = sup,¢47(2). Then II is a possibility measure. 


Proof. (i) We adopt the convention II(0) = 0. We have II(X) = sup, ex 7(x) 
=, 
(ii) Let {A;|i € I} C B. Then 


II (U a = sup{7(x)|x € U Aj} 


tel 1el 


= sup sup (xz) = supII(A;). 
i€I xe Aj iel 


Proposition 11.16. If II is a possibility measure then n(x) = II({a}) is a 
possibility distribution. 


Proof. We have to prove that 7(a%9) = 1 for some x € X. Since II(X) = 1 


and since we can write X = ( {a} we obtain 
Lex 


II(X) = sup H({x}) = 1 
LEX 


so there exists x9 € X with I({xo}) = 1, or equivalently (ao) = 1. a 


Proposition 11.17. Let X be a finite set and g: X — [0,1] be such that 


(i) g(0) =0, g(X) =1 
(ii) If AN B=0 then g(AU B) = max{g(A), g(B)}. 
Then g is a possibility measure. 


Proof. It is enough to prove that g(A U B) = max{g(A), 9(B)} with A,B 
not necessarily disjoint. For this aim we observe that 


AUB =(A\B)U(ANB)U(B\ A), 


which is a union with disjoint components. 
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Condition (ii) implies 
g(AU B) = max{g(A \ B),g(AN B), 9(B \ A)} 
= max{max{g(A \ B),g(AM B)},max{g(AN B), g(B \ A)}} 
= max{g(A), g(B)}. 

| 

The next theorem makes the connection between possibility measures and 

fuzzy measures. 


Theorem 11.18. A possibility measure that is continuous by descending 
sequences is a fuzzy measure. 


Proof. We can see that the condition II (u Ai) = sup,-, H(A;) implies 
ie 

monotonicity. Also, continuity by descending sequences is assumed. The only 

condition that needs to be proved is continuity by ascending sequences. Let 

A, C Ap ©... C An C... be an ascending sequence. Then, since the limit of 

an increasing sequence coincides with its supremum we get 


Remark 11.19. Continuity by descending sequences is assumed, it is not a 
consequence of the properties of a possibility distribution in general. If X is 
a finite set continuity by descending sequences is obtained, so the following 
corollary holds true. 


Corollary 11.20. A possibility measure on a finite set is a fuzzy measure. 


Proof. Let Ay D Ag D ... D An D ... be a descending sequence and A = 
() A;. On a finite set we have A = () A; = Ax for some & € {1,2,...}. 


i=1 i=1 
Similar conclusion holds for ascending sequences. The rest of the proof is left 


to the reader as an exercise. | 


11.4 Fuzzy Integrals 


We will study in the present section fuzzy integrals, i.e., integrals obtained 
starting from the concepts of fuzzy measure. We will dedicate most of the 
section to Sugeno integrals and their equivalent definition due to Ralescu 
-Adams and we discuss the Choquet integral too. 
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Definition 11.21. (Murofushi-Sugeno [113]) Let js be a fuzzy measure. The 
Sugeno fuzzy integral of a positive measurable function f : X — [0,co) on a 
measurable subset A C X is defined by 


(8) f Fay VV aAn(Fan A), 


a€ [0,co) 


where 


Fy = {xe X| f(x) > a}. 


Proposition 11.22. The Sugeno fuzzy integral has the following properties. 


a) If AC B then 
(8) f pans (8) f fay 
b) If u(A) = 0 then 
(s) ff du = 0. 


c) If c>0 is a constant then 


(5) f du =c p(A). 


d) For f,g: X > [0,0c0), f < g we have 


(8) f fan < (S) f 9 dy. 


Proof. The proof of a), b) and d) of the proposition are left to the reader as 
an exercise. Let us prove c) here. We observe that 


0 if c<a 


Fy ={v€ Xle>a}={ xX if ea 


(s) | eau = V aA p( Fy A) 


a€[0,00) 


={ V aad}v Vo adn(A)=cAn(A) 


a€[0,c) a€[c,oo) 
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Definition 11.23. (Ralescu-Adams, [124]) Let be a fuzzy measure and let 


n 
ss = ) OiXA; 
i=1 


be a simple function (i.e., piecewise constant with A; measurable). Further 
we denote by S the set of simple functions on X. Let 


Qa(s) = \V ai A u(AN Aj). 


i=1 


The Ralescu-Adams fuzzy integral of a positive measurable function f :X > 
[0,co) on a subset AC X is 


(RA) | F du =supQals), 
A ses 
Proposition 11.24. The Ralescu-Adams fuzzy integral given in this defini- 


tion has the following properties. 
a) If AC B then 


A A : 
(RA) f fay s (RA) ff ay 
b) If u(A) = 0 then 
A du = 0. 
(R fs 4 =0 
c) If c> 0 is a constant then 
A = A). 
(R ) f edu ch uA) 


d) For f,g: X > [0,c0), f < g we have 


(RA) f fae < (RA) fg ay 


Proof. The proof of a), b) and d) of the proposition are left to the reader 
as an exercise. Let us prove c) here. We observe that we can write s = cy 4 
which makes the integrand a simple function and then 


Qa(z) = cA p(A) 
and we obtain 
(RA) [ cdu=ch p(A). 
A 


Let us prove in the followings that the two integral concepts coincide. 
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Theorem 11.25. (see e.g. Gal-Ban [70]) The Takagi-Sugeno and Ralescu- 
Adams integrals coincide and moreover 


(8) | faw=(RA) fF du = suplu(A) A inf F(a) 
xX x AEB rE 


Proof. First we prove that 
(RA) ff du = supla(A) A inf Fo) 
x AEB rea 


Let A € B be measurable with infye4 f(x) = ao. Let us consider the simple 
function 
50 = AQ0XA- 


By the definition of sg we have so < f which allows us to write 
(RA) | fqu> (RA) [50 du > Q(s0) 
x x 


= ao A p(A) = (A) A inf f(x), VA eB. 
We obtain 
(RA) A f dye > sup[u(A) A inf, f(2)] 


For the converse inequality we take 
n 
s=) axa, <f. 
i=1 
Then 
n 
Q(s) = \V ai A (Ai). 
i=1 
Let us assume that the maximal element is attained at io i.e., 
Q(s) = Qin A L(A, ). 
Then we have 
io < inf 
Og S int f(x) 


(otherwise we would not have Q(s) < f(z)). 
It follows that 


Qs) < H(A) A inf fle) < supln(A) A inf, F(0) 


and finally 
(RA) I F dye < suply(A) A inf F(0)) 
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Together with the symmetric case we obtain 
(RA) [fd = suplw(A) A inf F(0)) 
x AEB rea 


For the Sugeno integral we take ao = infze4 f(x) then it is immediate that 


AC Fog = {# € X| f(x) 2 ao}. 


Then we get 
(8) { fdu= Vo adnan) 
a€[0,00) 
2 a9 A H(A) = w(A) A inf f(z) 
and finally 


S) ff du > suplu(A) A int fe) 
x AEB tEA 
Since F, is measurable we have F, € Bb. Then 


(5) f Fan VV anh pF, < VV ad p(A) 


a€[0,co) AcB 
a 


Example 11.26. (see e.g. Gal-Ban [70J) Let f : [0,2] — [0,00), f(a) = a. 
Let pw be the Lebesgue measure. The Lebesgue measure is in particular a fuzzy 
measure too. Then 


p{a| f(x) > a} = p{a € [0, 2]lc > a} =2-a 
and for the Sugeno integral we have 


(8) f ay = VV aAnu(Fa) 


a€[0,co) 


VV aA (2—a)=1. 


a€ [0,c0) 


Definition 11.27. (sce e.g., Sugeno-Murofushi [139]) The Choquet integral 
of a measurable function f with respect to the fuzzy measure p is defined as 


©) f tau= ” ual f(0) > a}da. 
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In what follows we give an equivalent definition. 


Definition 11.28. (see e.g., Sugeno-Murofushi [139)) Let 0 = ap < a < 
ag <2 < An and Aj = {2|f(x) > aj}. We have A, C ... C Ai. We define 
the Choquet integral of a function of the form 


as 


For an arbitrary measurable function f we define 


©) fs au =supi(C) | s duls E S,s < fh. 


Proposition 11.29. (see e.g., Sugeno-Murofushi [139]) The concepts defined 
in the previous two definitions are equivalent 1.e., 


J wlelf@) 2 ada =sup((C) fs dulseS,5< f}. 
0 
Proof. We observe that 


sup((C) | s du|s € S,s < ft 


= sup {3 p(A;) (a; — ai—1)|s < i} 


= [ wteif(e) > aaa, 


the later one being a Riemann integral. a 


We list below some properties of the Choquet integral. 


Proposition 11.30. (see e.g., Sugeno-Murofushi [139]) The Choquet integral 
has the following properties. 

1) fla du = p(A). 

2) faf du=af f dp. 

3) If f <g then ff dus fg dp 

4) Ifw<v then ff du< ff dv 

5) If u is the Lebesgue measure then the Choquet integral coincides with a 
Lebesgue integral. 
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Proof. The proofs of 1)-4) are left to the reader as an exercise. To prove 5) 
we observe that if 4 is Lebesgue measure then as in Definition 11.28 we have 


M(Ai) = w(Aig1) + (Ai — Ai+1)- 


Then 


which converges to the Lebesgue integral and we get 
(C) f sau f fay. 


11.5 Problems 


1. Prove Lemma [i110] 

2. Prove Proposition [1.12] 

3. Prove Properties a), b), d) of Proposition [1.22] 
4. Prove Properties a), b), d) of Proposition [IL.24] 
5. Prove Properties 1)-4) in Proposition [1.30 


6. Let f : [0,2] = R, f(x) = x. Calculate the Sugeno integral 


(S) f dp, 
[0,2] 


with pw being the Lebesgue measure. 


12 
Fuzzy Clustering 


12.1 Classical k-Means Clustering 


Intuitively, clustering means partitioning a data set into clusters (subsets) 
whose objects share similar properties, i.e., they are near to each other in 
some well defined sense for “near” (see e.g., Jain-Dubes [82]). In this section 
we discuss the classical k-means clustering algorithm which is one of the basic 
classical clustering methods. It also stands at the basis of the subsequently de- 
scribed corresponding fuzzy techniques. Also, Faber has proposed a con- 
tinuous k-means clustering method. We discuss here a fuzzy version of Faber’s 
algorithm the continuous fuzzy c-means method in Section [12.3] Those ideas 
are published here for the first time up to the author’s best knowledge. 

The classical k-means clustering (MacQueen [105]) is aimed to partition a 
data set into k clusters (classical subsets), k € N, such that the data contained 
within each cluster is near to an average value. 

More precisely the clustering problem can be formulated as an optimiza- 
tion question as follows. 


Clustering Problem. Given X = {21,22,...,0%} C R”, a data set, and 
k <n find S},..., 5, a partition of X such that it minimizes 


I((Si)i=t,...,k) (Mi)i=t,....k) = > > (lay — mill, 


i=1 2jES; 


where m,; is the mean of the points in S;, 7 = 1,...,k. We can simplify the 
notation above to J(S;,m,;), for convenience. 
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The following algorithm is called k-means algorithm and it is aimed to 
solve the above clustering problem. The algorithm consists of two steps. 


k-means algorithm. (MacQueen [105] ) 


Assign: 
Si = {£p| [lap — mall < |lap — myl| 5 = 1-1 B} 
Update: 
ae 2 aes v5 
[Sip 
where |S;| = ee gs, | denotes the cardinality (number of elements) of the 
finite set. 


Proposition 12.1. The k-means algorithm converges in the sense that after 
a finite number of steps neither the Assignment nor the Update steps modify 
the output of the algorithm. 


Proof. It is easy to check that both the assignment and the update steps 
decrease the objective function. Indeed, if e.g., S; denotes the partition before 
update then we can denote 


A 
J 


fy ie Bl, 


If a given value x, was previously “misplaced” in 5}, i.e., 


Si = {2p llzp — mill < ||zp — m 


f 
j 


I|zq — mj,|| = |e —™MsilI 5 


for some j € {1,...,k} then it will be placed in S% and in this way J(Sj, mi) 
will decrease. 

Let us analyze now the update step. We observe that if the sets S;, 7 = 
1,...,k are fixed we have 


OJ 


om; 


=2 » (mj; —2;),t=1,...,k 


apes; 


and also, J is convex. Then a local minimum of J is a global minimum and 
it is attained at its critical point i.e., 


m > l= >> 3; 


2jEeS; wzgeSy 


and finally 
ae ES; vj 
Popes: iL 


Since the point is a global minimum, the update step will decrease the value 
of J(S;,m;). Finally since the search space for our problem is a finite set and 
since every step decreases the value of the functional J(.S;,m,;), the algorithm 
will be convergent. 7 


my = 
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12.2 Fuzzy c-Means 


A crisp partition of a set does not allow partial membership degrees of a point 
in a cluster. Often it is convenient to have soft boundaries for clusters because 
e.g., a given point cannot be harshly categorized as belonging to a cluster or 
another. To allow partial membership to the clusters, these will need to be 
fuzzy sets. Based on this idea and based on the classical k-means algorithm, 
Bezdek proposed the fuzzy c-means algorithm described in the followings. 


Fuzzy Clustering Problem. (Bezdek [28]) Given 
X= {G1 02; ee Cc R”, 


a data set, and c < n and m > 1, find a fuzzy partition wu1,...,ue of X, i.e., 
fuzzy sets on X that fulfill the property 


c 
So wk =1, wn = ui(rr) 
i=1 
such that the functional 


Cc n 


I(u,v) = S>S> (win) lle — vill? 


i=1 k=1 


is minimized, where 


y= ee. 
' ae Gag)” 


is the center of the i — th cluster, 7 = 1,...,¢. 
The fuzzy c-means algorithm has two steps. 


Fuzzy c-means algorithm 
Assignment: 


Ue > Sit a lyre 


Sale) 
J=1 \ dix 


where 


dik = |lax — v;||,0 =1,..,¢,k =1,...,0 


and the norm is the Euclidean norm in R” (however other norms could be 
also considered). 
Update: 


_ Sper (tan) te 


Ui= 1=1 


oi (wiz) ’ TAs 


Considering the fuzzy clustering algorithm we can prove the following 
result. 


“5 Gs 
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Theorem 12.2. (Bezdek [28)) The fuzzy c-means algorithm converges in the 
sense that J?(u,v) converges (J? denotes the value of the objective function 
in the p-th iteration). 


Proof. First we will consider the functional 


Cc n 


F(a, 0) = 2 (uin)™ Nae — oll, 


i=1 k=1 
as a function of uj, with fixed v;, and we prove that it has a minimum at 


1 


Uik = —— 2 = 1, wong Cw 
Se diz, \™—2 
J=1 \ djx 
Indeed if we consider the Lagrange function 


L(u,v) = 50 (wax) Ilex — vill? + 5 x (: = >] 
k=l i=1 


i=1 k=1 


we obtain 
OL 


Oui 
with di, = ||a, — vi||. Then 


=o 
Ak m—1 ; 
Wik = me 5 Liesig Cs 
Mar 


The fuzzy partition condition implies 


c ¢e 5 wH 
dim (ma) =! 


i=1 


1)" - 
mse) 


Then we obtain the critical point 


= m(uin)” d?, — Xx 


and we obtain 


It is easy to check that the Hessian is positive semidefinite and so it is a 
convex function in its domain, and then u;, provided by the assignment step 
is a local minimum of J(u,v), which is in particular a global minimum too, 
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because of convexity. As a conclusion J(u, v) is decreased in every assignment 
step. 

Then, considering J(u, v) as a function of v; with fixed u;, we can find a 
critical point of J(u,v) from 


as 


Similar to the previous step the Hessian is positive semidefinite and so J(u, v) 
with fixed u has a local minimum at v;, which is a global minimum too, and 
so the functional J(u, v) is decreased in every update step. 

Together the two steps of the algorithm will decrease the objective func- 
tion, which ensures that the algorithm is convergent the objective function 
being bounded from below by 0. | 


Remark 12.3. Surely the above theorem ensures only the convergence of the 
algorithm without proving that it indeed converges to a local minimum of the 
functional J(u,v). A deeper investigation of the fuzzy c-means algorithm is 
possible using Karush-Kuhn-Tucker theorems (see Jain-Dubes [82]). 


12.3. Continuous Fuzzy c-Means 
Starting from Bezdek’s fuzzy c-means [28] and Faber’s continuous k-means 


[57) algorithms we can combine them into a continuous variant of the fuzzy 
c-means algorithm. 


Fuzzy Clustering Problem. Given 2 C R”, a region, and c € N, and 
m > 1, find a fuzzy partition Aj,...,A_. of X, i.e., fuzzy sets on X that fulfill 


the property 
i=l 


such that the functional 


is minimized, where 


ad iA de 


is the center of the i — th cluster, 7 = 1,...,¢. 
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The continuous fuzzy c-means algorithm like its other variants will have 
two steps. 


Continuous fuzzy c-means algorithm 


Assignment: 


1 
CC —————r ee 


= 
y ({=4) mat 
J=1 \ [le—eyl 
The norm can be any norm in R” (however in the present discussion we use 


the Euclidean norm). 
Update: 


gfe ON) oe 
Ja Aen ee 


Considering the continuous fuzzy clustering algorithm we can prove the fol- 
lowing result. 


Theorem 12.4. The continuous fuzzy c-means algorithm converges in the 
sense that J?(u,v) converges (J? denotes the value of the objective function 
in the p-th iteration). 


Proof. The approach presented here is not the most elegant, because it 
reduces the problem described here to the previous situation using a Riemann 
sum for approximating the integrals. First we will consider the functional 


I(u,v) = / (Ai())™ lla — vill? ae, 
i=l Q 


as a function of A;(a) with fixed v;. We can approximate the functional 
J(u,v) using a Riemann sum 


Cc n 


In(u,¥) = » d/ Ai(ze))” lle — vill? (we41 — ee). 


and by the proof of Theorem [12.2]it has a minimum at 


1 
Fs a a as eT 


c ( |xxmvil]\ 7 
dy=i (f=) 


If the assignment step calculates 


1 
CC  ———————e 


© ( \je—vel) \ 
Din (HHH) 


then A;(az,) is automatically getting the value as described above, and so 
at the Assignment step the value of J,,(u,v) is reduced, for any value of n. 
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J(u, v) is within the approximation error of the Riemann sum, but it is still 
possible that it is increased. Let us assume that 


|J(u,v) — Jn(u,v)| <e. 
Then 
In(u,v) —€ < J(u,v) < In(u,v) +6, 


i.e., however J(u, v) may increase, at an individual step, its approximation 
Jn(u,v) is decreased at the assignment step. 

Then, considering J(u, v) as a function of v; with fixed fuzzy partitions we 
can find a critical point of J(u, v) from 


om =-2 f (Ai(2))" 45) dx =0 
Q 
and we obtain ” ad 
25 da’ 


Similar to the previous step the Hessian is positive semidefinite and so J(u, v) 
has a local minimum at v;, which is a global minimum too, and so the func- 
tional J(u, v) is decreased in every update step. Same can be said in particular 
about J;,,, which also decreases at every update step. 

Taking € = + we obtain that in the assignment step we have 


1 1 
Jn (u,v) _ - < J(u, v) < Jn (u,v) + ne? 


so J(u, v) is bounded by the sequence J;,(u,v) — + and Jp(u,v) ++ and so 
the algorithm converges. a 


12.4 Problems 


1. Let us consider the functional 


c 


nm 
Set flare — v4(|? 


i=1 k=1 


Describe a fuzzy c-means algorithm that should minimize the given func- 
tional. 


2. Prove that the algorithm described in Problem[Jis convergent. 


3. Investigate generalizations of the fuzzy c-means algorithms similar to 
Problem [i] 


13 
Fuzzy ‘Transform 


13.1 Definition of Fuzzy Transforms 


Fuzzy Transform was proposed in Perfilieva in [121] and Perfilieva [120] and 
it is an approximation method based on fuzzy sets. Also, it can be seen as 
a fuzzy set-based analogue of the Fourier Transform. In the present chapter 
we follow in great lines the presentation and discussion in Bede-Rudas [23]. 


Definition 13.1. A fuzzy partition of an interval [a,b] is defined as a family 
A = {Aj, Ao,..., An} of fuzzy sets on [a,b], A; : [a,b] > [0,1],2 =1,...,& such 
that 
k 
S > Ai(x) = 1,¥e € [a, 8). 


i=1 
The fuzzy sets A; are called the atoms of the partition. 


Example 13.2. We consider a classical partition a = yo = yi < ... < YR = 
Yr+1 = 0 of the interval [a, b|, with triangular fuzzy numbers 


Ay = (sa Pat) S Le he 


These fuzzy sets form a fuzzy partition (see Fig. : 


Ifa=yo <yi <... < Ye < Yeti = 5 is a classical partition of the interval 
[a, b] and let 6 = max;=o,...,z |yi+1 — yi| be the norm of the partition. 

In what follows we present the Fuzzy Transform (F-transform) proposed 
in Perfilieva [121]. 
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Fig. 13.1 A fuzzy partition with triangular atoms 


Definition 13.3. (Perfilieva [127)) We consider a fuzzy partition A. The 
continuous F-transform is given by 


i= f A; (x) f(x)dx (13.1) 
[2 Ai(a)de ” 
i=1,...,k. 
The discrete F-transform is given by 
he ja Ai(as) f(z5) (13.2) 


doje Ailey)” 


where x; € I, j = 1,...,n are given data (n > 1) such that for each i € 
{1,...,k} there exists p € {1,...,.n} with x» CsuppAj, i.e. in the support of 
each atom of the partition we find at least one data point. 


where f; are the components of the continuous F-transform. 


Definition 13.4. (Perfilieva [121]) The continuous inverse F- 
transform is 


Fi,(a) = » A; (2) fi. (13.3) 


where f; are the components of the continuous F-transform, and the discrete 
inverse F-transform is 


Fra (@) = DL Ail) fi (13.4) 


where f; are the components of the discrete F-transform. 
Positive linear operators are playing a special role in our investigation. 
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Definition 13.5. For the discrete case let Fn, : C({a,b]) + C({a,b]) be 
given by 
Fn k(f)(£) = Frx(2), 
where Fy,.(%) is given by and f; given by (19.2). The operator Fy,,x, is 
called the discrete inverse F-transform approximation operator. 
If we consider the composition between the inverse F-transform and the 
continuous F-transform we take Fy : C({a, b]) + C({a, b]), given by 


Fx(f)(@) = Fr(2), 
where Fi,(a) is given by and fi given by . The operator Fy, is 
called the continuous inverse F-transform approximation operator. 


Example 13.6. Let us consider the fuzzy partition with four triangles in 
Fig. 13.1 


A, = (0,0, 1), A2 = (0,1, 2), A3 = (1, 2,3), Ag = (2, 3,3) 


Let us calculate the components of the continuous F-transform associated to 
the function f(x) = x?. 


iG —a)a*dx 1 
A= = 
fo Q-—2)dx 6 


f i. xudx + f7e —a)a*dx 7 
QL oT 
{, xdx + fi —ax)dx 6 


a2 {Pa —1)z2dx + ING — x)x*dx _ 25 
fila —1)dr+ £C — x)dx 6° 

ha (a — 2)x%dxr _ 2 

f@ — 2)dax 6° 


Then the inverse F-transform becomes 


Fu(f)(0) = Fe(2) = A(o) 5+ Aol) 2 + Ag(a) 2 + Aula) 2. 


The direct and inverse continuous F-transform are illustrated in Fig. (13.2) 
The more practical discrete F-transform can be numerically calculated. 


Example 13.7. Let us consider a fuzzy partition based on trigonometric 
functions. Let a= yo < ... < Yn = b be a partition with equally spaces knots 
Yi=ath-t, withh= ba i=0,...,n. Let us consider y-1 <a, b < Yn4i 


two auailiary knots. Let us take (see Fig. (13.3) 


AG 4 (cosf(e—y:)+1) if x [yi-1, yi+] i=0 

; 0 otherwise = 
Let us calculate the discrete F-transform associated to the function f(x) = x?. 
The direct and inverse discrete F-transform are illustrated in Fig. [13.4 
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Fig. 13.3 Fuzzy Partition with trigonometric membership functions 


Proposition 13.8. F,,,, € £(Cla, b]) and Fy € L(Cla, b]) are positive linear 
operators. 


Proof. The proof is left to the reader as an exercise. a 


Also, we can regard each of the direct F-transforms f; as a linear form f; : 


C([a, 6]) > R, £,(f) = fi as in (E30) or (13-2). 
An interesting result concerning F-transforms is their optimality property 
obtained in Perfilieva {121}. 
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Fig. 13.4 Direct and inverse discrete fuzzy transform 


Proposition 13.9. For each i = 1,...,k, the point y = fi, (with f;, being 
a component of the continuous F-transform) minimizes in terms of y the 
function 


b 
By) = / (f(a) — 9)? Ad(o)de. 


Proof. We observe that a minimizer has to be a critical point of the convex 
function ®, i.e., 


b 
oy) =-2 f (Fe) —WAi(ojar =0, 
and we obtain that the critical point is indeed the F-transform 
b 
A; d. 
= dane) ae ; CHOL ee ee veers 
J, Ai(a)da 7 


Proposition 13.10. The component f; of the discrete F-transform mini- 
mizes in terms of y the function 


&(y) = > (F(@s) — 9)? Alay). 
j=l 
Proof. The proof is left to the reader as an exercise. 


13.2 Error Estimates for F-Transforms Based on Fuzzy 
Partitions with Small Support 


The original definition of the Fuzzy transform assumes a fuzzy partition with 
small support. In this case the uniform convergence of the composition of the 
inverse and direct F-transform was shown in Perfilieva [[21]. We consider a 
generalization proposed in Bede-Rudas [23]. 
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Theorem 13.11. (Perfilieva [121), [120]) Leta = yo < yt << yn < 
Yr+1 = b be a partition of the interval [a,b] having the norm 6. If A = 
{Aj,..., An} is a fuzzy partition with 


(Ai)o © [yi-1, yeti], 4 = 1,..., 4, 
then the following error estimate holds true 
IFnw(f)(2) — f(x)| < 2w(f, 6), Va € [a,b], 


where Fnn(f)(a) denotes the discrete inverse F-transform approximation op- 
erator. 


Proof. Let x € [a,b] be arbitrary fixed. The discrete inverse F-transform 
approximation operator can be expressed as 


7 l= 1 Ai(x5) f (5) 
2. Asay) 


So (ey a esd) 


fa) = a dja1 Ail) 
Then we get 
IFne(f)(x) — f(x)| 
ouE 1 Ai(x;) F(x) — F(@s)| 
<A a4 Aj (x i) 


and from Theorem we have 


jar Ai(x) Ai(x;)w(f, |e — x5) 
fale ee 1 Ai(z;) , 


We observe that the product A;(x)A;(z;) # 0 only when z,z; are in the 
same interval [y;—1, yi+1]. In this case we have |x — x,| < 26 and we get 


(a, S 
Fax f)(2) - j(n) <2) eee 


j=l 


\Fnw(f) (2) 


and finally 
|Fn,w(f) (x) — f(x)| < 2w(F, 6). 


In the next theorem we obtain an error estimate in the context of a fuzzy 
partition with small support. This below result slightly extends those in Per- 


filieva [121]. 
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Theorem 13.12. Let a= yi_-r < yi < .. < Ye < Yrtr = b be a partition of 
the interval [a,b] having the norm 6. If A = {A1,..., Ax} is a fuzzy partition 
with supports 


(Ai)o © [yi Yetr],¢ = 1,..., 


then the following error estimate holds true 
\Fnw(f)(@) — f(@)| < 2rw(f, 6), Ve € [a, 4, 


where Fnx(f)(«) denotes the discrete inverse F-transform approximation op- 
erator. 


Proof. The proof is left as an exercise. | 
The following Corollary gives the uniform convergence of the composition of 


the direct and inverse discrete F-transforms. 


Corollary 13.13. If f is continuous, then there exists a sequence of fuzzy 
partitions A,, such that the composition of the inverse and direct discrete 
F-transform converges uniformly to f. 


Similar results hold for the case of continuous fuzzy transforms. 


Theorem 13.14. Let a = yo < yi < .. < YR < Yes = 0 be a partition of 
the interval [a,b] having the norm 6. If A = {Aj,..., Ax} is a fuzzy partition 
with 


(Ai)o c [yi-1, Yiti],2 = 1, sy A 


then the following error estimate holds true 
IFu(f)(@) — f(x)| < 2w(f, 6), Va € [a,b], 


where Fy(f)(x) denotes the continuous inverse F-transform approximation 
operator. 


Proof. Similar to the proof of Theorem [13.11] we have 


Aj( f,ja- 
se <M set iia 


Since the product A;(a#)A;(t) 4 0 if and only if w,¢ € [yi-1, yi+i], and in this 
interval we have |x — t| < 26 we get 


\Fx(f) (2) 


i A;(a) A;(t)dt 


IFx(f) (2) He) <2 tH 
< 2w(f, 6). 
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Theorem 13.15. Let a = yo < yi <<... < YR < Yeo = 0 be a partition of 
the interval [a,b] having the norm 6. If A = {A,..., Ax} ts a fuzzy partition 
with 


(A;)o CG [yi—r; Yitr|,t = ile see k 
then the following error estimate holds true 
Fn (f)(x) > f(z)| < 2ru(f, 6), Var € [a,b], 
where Fx(f)(x) denotes the continuous inverse F-transform approximation 
operator. 
Proof. The proof is immediate, being similar to the proof of the previous 


theorem. | 


Corollary 13.16. If f is continuous, then there exists a sequence of fuzzy 
partitions A,, such that the composition of the inverse and direct continuous 
F-transform converges uniformly to f. 


13.3. B-Splines Based F-Transform 


Let us recall the definitions of the classical B-splines of order r—1 with r > 1. 
Let to < t1 <.... <t, be points in R, with t, 4 to. The B-spline M is given 
by 

M (a) = M(a;to,...,tr) =1[to, ..., tr] — ay 


where for fixed x, the notation (- — x); denotes the function 
(= 2), () = (t— 2) = max{0,t— 2} 
and [to, ...,t,| denotes the divided difference of f (see e.g. DeVore- Lorentz 
[43]) defined recursively as 
[te] f = f(te), & =0,...,7 
ates leeeiy sey baly — [ten aly 


by, ,0 < —L<7 <r. 
i i<j<r 
The B-spline N is defined by 
1 
N(a; to, ...,tr) = —(tr — to) M(a; to, ..., tr). (13.5) 
Tr 


Let to < ti < ... < ty be a sequence of points in a given interval [a, }], 
called basic knots. We need some auxiliary knots t_,41 < ... < tp) = a and 
b=tn4i <... < tny,. To a given sequence of knots corresponds a sequence 
of crisp B-splines 

Nj (a) = N(a3 ti, ..., tite), 
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Fig. 13.5 Cubic B-spline based fuzzy partition 


for i € {-r +1,...,n}. The following identity holds 


n 


sy A= (13.6) 


t=—-r41 


i.e., the B-splines form a fuzzy partition. Cox-de Boor recursion formula (see 
DeVore- Lorentz [43]) is important both from practical and theoretical point 
of view 


lift;<2 < tiga 
0 otherwise 


N} (2) ={ 
Ct 


NE (@) = Fn) + no), 
Cigr—1 — ty lige — bi41 

for any r>2,i=-—r+1,...,n. 

If we consider an equidistant knot sequence, B-splines form a fuzzy parti- 
tion as shown in Fig. [13.5 

Based on the results of the previous section we consider the B-spline based 
fuzzy transform proposed in Bede-Rudas [23]. The B-spline-based continuous 
F-transform is given by 


_ SENT (@) f(@)de 


; ,>t@=—rt+l,..,n 
J, NP (a) dx 


fi 


and the discrete F-transform is 


f= doin Ni (@5) F (@s) 
— paar Nj (x5) 


,»t=-—rt+l,...jn 
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where x; € I, are given data (j = 1,...,m). The composition of the inverse 
and direct F-transform for x € [a, 6] is 


n 


FAip@ = >> Ni @)fs 


t=—r+1 


for the continuous case, and 


for the discrete case. 


Proposition 13.17. Let f : [a,b] > R be a continuous function and let 
Fn(f)(a) and Fnin(f)(x) be the inverse B-spline based F-transform approzi- 
mation operators. Then we have 


lFn(f)(x) — f(x)| < rw(f, 6) and (13.7) 
\Fn,e(f)(2) — f(x)| < rw(f, 6) 


where r — 1 is the order of the spline considered, and 6 = max?_, |ti+1 — til. 


Proof. The proof is similar to that of Theorem [13.12] and it is left to the 
reader as exercise. 7 


The estimate in (13-7) can be generally improved, but if r is small compared to 
n, we have a sufficiently good estimate. In applications, to keep the problem’s 
simplicity one needs to choose a relatively small value for r. Indeed, the most 
popular applications of classical B-splines use cubic splines. 


Example 13.18. We will take F-transforms and inverse F-transforms of the 
functions fi, fo: [0,1] > Ry 


(13.8) 


1 
— 9 in. —————_ 
fi(z) +sin 045 


and 
1 if O<a<04 


fo(a) =< 10x-3 if 04<a<05 . (13.9) 
2 if 05<a<l 


B-splines of different orders can be used to approximate these functions on 
the [0,1] interval. We use cubic B-splines here. In Fig[13.6] we show the F- 
transform approximation for the function fy. 

In Fig. cubic B-spline based F-transform is considered for the func- 
tion fo. 
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Fig. 13.6 Approximation by cubic B-spline F-transform. Dashed line = fi, solid 
line = inverse F-transform 


2.04 


0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 


Fig. 13.7 Approximation by cubic B-spline F-transform. Solid line = f2 Dashed 
line = inverse F-transform 


13.4 Shepard Kernels Based F-Transform 


We consider in what follows a Shepard-like fuzzy partition. This was proposed 
in Bede-Rudas [23]. 


Definition 13.19. Consider yo < ... < yr € [a,b]. We say that a fuzzy 
partition A = {Aj}ie{o,...,n} determines the Shepard-like fuzzy partition if it 
is of the following form 
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Fig. 13.8 Shepard type fuzzy partition 


|o—yil~* : 
Aj(z) — DV eolt@—usl >” if x € (a, b] \ {Yo, 5 Ye (13.10) 
dij, otherwise, 


where 6;; is Kronecker’s delta, and \ > 2 is a parameter. 


We consider the interval [0, 1] and the points yy, ..., y, are considered equally 
spaced. Now, let us recall that if z;, 2 = 1,...,n are equally-spaced points in 
the unit interval then 


(>: eat] = O(n), (13.11) 


i=0 


for any y > 1 (see Szabados [142]), where f(h) = O(g(h)) has the usual 
interpretation, i.e., there exist C,2o such that f(a) < Cg(x) for any x > ao. 
Let us recall the following lemma: 


Lemma 13.20. (Xiao-Zhou [152/, Lemma 1)For any x € [0,1] and y > 1, 
if zi, 7 =1,...,n are equally-spaced points in the unit interval then 


|e — 2n|77 -7 
=a < O(([(n + Iz] —k] 41), (13.12) 
Dizo |e — 2il77 
where [x] is the greatest integer not exceeding x. 


The following theorem provides an error estimate for the inverse F-transform 
based on Shepard kernels. 


Theorem 13.21. (Bede-Rudas [23]) Let yo,..., yx and %,...,2n be equally- 
spaced points in [0,1]. If Aj(x) denote Shepard kernels (13.10) having the 
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parameter X > 2, then for the discrete inverse F-transforms approximation 
operator Fn~(f)(x) given by and there exists an absolute con- 
stant C’ such that the following error estimate 


Fax Ale) — F(@)| < Cw (s. ~) | 


m 
holds, with m = min{n, k}. 
Proof. As in the proof of the previous theorem we have 


fois EE =o Ai(e) As (aj )w(F [2 — e 9) 


coat Dyce Ailes) 


The following inequality is obtained from properties of the modulus of con- 
tinuity: 


IFne(f)(@) — f(@)| (13.18) 


wie o Ai(@;) |@ — a5 a 
c(14myo ac ye Ailey) (12). 


We have to estimate the expression 


oy : do j=0 Ai(w;) lw — 25| 
rar i<o Ai(z;) 


is -A leg yil* 
yr ea wl Dino Sisal 
— k = x : 

i=0 Li=o |@ — yl pee jej—yil” 


j=0 Yeolai—yil* 
We observe that 


Eagle) = So ys desl ea 
n, ke) = ea << 
i=0 Limo |Z — yl j=0 DY j=0 |zj — ysl 


k = 
< la — ys 2s lzj — ysl * (la — ysl + |2; — yil) 
= 
= ele al j=0 ys 0 Iz5 — vil 
aE Seen alee) bse 
=~ mk I a 
i=0 Lixo |Z — yil 6 j= o |g — Yi 
k =i = 5 
eo |x — ysl |zj — vil 


k —X rT Es |zj — ysl - 
i=0 Lai=o It — yl j=0 ea, |z5 — yi 
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From Lemma|13.20} for the equally spaced points yo, ..., yx, we have 


jz — ys|* 


k = 
Yi=o lz — yi| 


and for the equally spaced points Zo, ...,%p, we obtain 


= O(\[(k+12]-a+1)*, 


— 
lj — yil 


Se O (\[(n + 1)yi] - 3] +1), 
j=0 1% i — Yi 


and it follows 


k 
Ho) =0 (al [(k + la] — i] +1) |x — a/h| 


Sc (n+ 1)y;) —j| 41) * 
j=0 


3 


k 
(Ea [(& + 1)2] — i] +1) -*- Se (l[(r + ys) — J] +1) i/n — wil 


=0 g=0 


°. 


i=0 


k 
1 Xr 
-0 (74 (k+1)a] — i] +1) |ke — i]- Pm [2 + 1)y] — j] +17 


n 


k 
1 
+0 | = S> (ll + Vz] = i] +1) SO (Nl + Doe) = J + 1)* Irs — i 
i=0 j=0 


Now let us observe that |kx — i] < |[(k + 1)a2] — i] + 1. Indeed, if kx > i we 
have 


|ka —i] =ka -i<(k+l1)a-i 
< |[(A + 1)az] —2+1] < |[(A+ 1a] -2] 41. 
Similarly, if ka <7 we obtain 
|ka —i] =i-—ka <i-(k4+1)a 
< |[(& + 1)z] — 4] < |[(K + 12] - 4] +1. 


Also, we have 
Inyi — 91 S [[(m + 1)y] - 5] +1 
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and we obtain 
1 k n 
_ —A+1 
Enu(v) =O | FD (I +12] — i +1) Del [(n + 1)yi] — i] +1) 


n 


k 
+O “>. (\[(& + 1a] — i] + iy . ([(m + Lyi) — gi) + 1-44 
i=0 70 


We observe that 


En,n(x) = O 2 Ce 3 a 
a=l Ba=l 


ye, S00 
B=1 
and so 
> Ba*** = O(1) 
B=1 
we obtain 


Now in we get 


Fna(Ae)— sol < (1+m(o(F) +0()))w (42), 


If we put m = min{k,n} we get m(O (4) +O(4)) = O(1) and finally we 
obtain that there exists a constant C' such that 


FanlN(e) — fla) s Cw (1). 
|_| 


Corollary 13.22. If A;(x) denote Shepard kernels (13.10) having the pa- 
rameter \ > 2, then the composition of the inverse and direct F-transform 


given by and {£3.2)) converges uniformly to f. 
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Fig. 13.9 Approximation by Shepard type F-transform. Dashed line = fi, solid 


line = inverse F-transform 


i T T T 
0.0 o4 0.2 03 0.4 0.5 0.6 0.7 


Fig. 13.10 Approximation by Shepard type F-transform. Dashed line = fo2, solid 


line = inverse F-transform 


Similar result can be obtained for the continuous F-transform with Shepard 


kernels. 
Example 13.23. Functions fi, fo in (13.8), (13.9) are approvimated by 
Shepard type inverse F-transform operators. The results are shown in Figs. 


respectively. 
13.5 Korovkin Type Theorems for the F-Transform 


The first of Korovkin’s Theorems is an important result in classical approxi- 


mation theory. Let us recall it here. 
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Theorem 13.24. (Korovkin [96)) Let Ln € L(C{a,b]), n = 1,2,... be a 
sequence of positive linear operators. If limn+oo In(e:) = ei, =0,1,2 where 
eo(z) = 1, e1(z) = 2, e0(z) = x7, then limn40In(f) = f, for any f € 
C{a, b]. 


A particularization can be considered for our F-transforms as follows: 


Theorem 13.25. (Korovkin’s Theorem for the discrete F-transform, see 
Bede-Rudas [23}) Let Fux € L(Cla,]), nk = 1,2,... be the composi- 
tion between the inverse and direct discrete F-transforms with respect to a 
fixed fuzzy partition. The following general error estimate holds true for any 
d6>0: 


AnGi-t1S Ae ares een 10, 
6 


where e1(x) = 2, €2(x) = 2”. 


Proof. The composition of the inverse and direct discrete F-transform can 
be expressed as 


k A Aj(a;) f(x; 
Fa k(f) (x) = De Ao) Sen 


Let us observe that for the inverse F-transform we have Fx (e9) = eo, where 
eo(x) = 1 Va € [a, b], and it is immediate to observe that 


k vent, Ault) (Fe) = Fey 
Foal) = f(a)] < Yo Ae) Tt 


and then by standard reasoning 


IFnw(f) — f(@)| 


E 4-1 Ai(z;) |e — 2; 
as (: + Fae) w(f,d), 


for any fixed 6 > 0. The error is controlled by the ratio 


: 4-1 Ai(x;) |e — 2; 
Rn,x(£) = Be ea 


3 Sm Aa) (13.14) 
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Using Cauchy-Schwarz inequality we have 


S¢ Ai(a,)|@ — vi] < | $0 Ai(x,)|@ — 25)? S Ai(2;) 
j=l j=l 


j=l 
and using Cauchy-Schwarz inequality successively we obtain 
1 
a 
’ oom A; (xj) | — x3!) 
¢) ~— 


a (ys A,(2x3)) : 


NIFR 


i=1 os Ac(a))* 


k 2 k A im Aj : sod de | 3 
< S> Ai(2) S- (x) dj=t (x;)|e — 25 

i=1 i=1 yet A;(z;) 
Since A;(a) is a fuzzy partition we have 


de , Ai(x;) (x? — 220; +27) 2 
wor (Sate a ar A;(x;) 


and finally 


Ry,w(@) = (a? — 22Fn,e(€1)(%) + Fn,n(€2)(2)) * , 


which completes the proof. a 


Corollary 13.26. [f 


lim Fn (ei) = ei; 
n,k> 


i= 1,2, then 
lim Frik(f) = f, 


n,k—-0o 
for any f € Cla, b]. 


If we consider the case of the continuous F-transform then we obtain a similar 
result. 


Theorem 13.27. (Korovkin’s Theorem for the continuous F-transform, Bede- 
Rudas [23)) Let F, € £(Cla, b]), k = 1,2,... be the composition of the inverse 
and direct continuous F-transforms. The following general error estimate 
holds true for anyd >0: 


IFe(f) SIs (14+ 5Ve—2aFie) + File) 


where e1(x) = 2, €2(x) = 2”. 
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Proof. The proof uses the integral version of Cauchy-Schwarz inequality and 
it is left to the reader as an exercise. a 


Corollary 13.28. /f limp... Fx (ei) = e:, i = 1,2, then limn+0Fr(f) = f, 
for any f € C[a, b]. 


The Korovkin type Theorems above show that if we are able to have small 
values of 


E = 4/e2 — 2e1Fn4(e1) + Fnn(e2) 


for the discrete case, or 


E = vV/eg — 2e1F x (e1) + Fr(e2) 


for the continuous case, for a given sequence of fuzzy partitions A;,i = 1,...,k, 
then we have small approximation error for any continuous function. 


13.6 F-Transform with Bernstein Basis Polynomials 
and the Durrmeyer Operator 


Using the Korovkin-type results we can study F-transforms with Bernstein 
basis polynomials used as a fuzzy partition this time. The proposed con- 
struction leads to the well-known Durrmeyer operator (Bede-Rudas [23]). 
The Bernstein basis polynomials are 


rate) =(F 


‘eit _ ae, 
a 
k=1,2,...i1=0,1,...,k x € [0,1]. In Fig. [38-T]Jelements of Bernstein basis 
are illustrated. 

It is easy to check that 


k 
S Pn,i(@) =(¢+(1—2))* =1, 
i=0 


i.e. Dn; is a fuzzy partition. 
The inverse F-transform is given by 
k 1 
Jo Prei(a) f (x) dx 


Fr L)= i(@ T 
n(f) (x) 2, Pal ) aahas 


that is the classical Durrmeyer operator Durrmeyer [53]. 


Theorem 13.29. Let f : [0,1] > R be continuous, and let Fy(f)(x) denote 
the inverse F-transform approximation operator, i.e., the Durrmeyer opera- 
tor. Then the following error estimate holds true 


irc ssc ( 4/2), 


? 
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Fig. 13.11 The Bernstein basis polynomials 


Proof. Let us calculate F,(e,) and F;,(e2) in this case. It is easy to check 
that 


Dr i(£) a k(pe—1,i-1(2) — Pr-1i(2)). 


By integrating we obtain 


1 1 
i Pr—1,i-1(x) da =, Pr—1,i(x)da, 
0 0 


i.e., for fixed & the integrals of all Bernstein basis polynomials are the same 
namely 


1 
| Pri(x)dx = t= 1,...,k. 
0 


By direct calculation 


1 LER | 
: prs(ojade = | (Pata — 2a 
0 0 1 


ie r itl 
= 4 CS. 
k+1 Jy Pk+1,i+1 (k+1)(k +2) 


1 tS. | 
ff restayatar = f° (5242 -2)ar 
0 o \a 
atti nd 
= pel & ao R Pk+2,i+200 
CEN?) 
(k +1) (k +2) (K+3)) 


Also, 
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Then we obtain 


1 
i d: . 
tay = tates _ 641 _ 9 (2) 
and | 
f,(e,) = Lo Pesle)a*de 
Jo Pri (a)de 


— G41) G42) _ i? 
(k + 2) (k +3) o( i: 


k : 
Fi(e1)(2) = O (doretrg] 


i=1 


= O(Bx(e1)(x)) = O (e1), 


where B; denotes the usual Bernstein operator 


B(N)(2) = Srl (=) 


and it is well known that B;,(e1)(#) = x. We also have 


241 


and finally we obtain: \/e2 — 2e1Fx(e1) + Fu(e2) = Oy/ “4 —) and by the 


above Korovkin type results we have 


|Fe(f) - fll < Cw (« \/ =) . 


Example 13.30. We consider the problem to approximate f,, fo in (23.3), 
by Bernstein inverse F-transform. The results are illustrated in Figs. 
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Fig. 13.12 Approximation by Bernstein type F-trasform. Dashed line = f; Solid 
line = inverse F-transform. 


Fig. 13.13 Approximation by Bernstein type F-transform. Dashed line = f2, solid 
line = inverse F-transform. 


13.7 F-Transform of Favard-Szasz-Mirakjan Type 


It is possible to further generalize Fuzzy Transforms by considering un- 
bounded intervals and infinitely many atoms for a fuzzy partition. Let f : 
[0,co) + R be a bounded function. We consider now on the [0, oo) interval 


13.7 F-Transform of Favard-Szdsz-Mirakjan Type 243 


the fuzzy partition A = (Ao, Ai,....), with 072, Ai(x) = 1, Va € I. We can 
consider for example a Favard-Szdsz-Mirakjan kernel (see e.g. Gal [67]) 


(nax)" 


i! 


Aj(x) =e" 


n>1,7=0,1,.... The continuous F-transform in this case is given by 
ea A; (a) f(x)dx 
and the discrete F-transform is given by 
dja Ai(ay) f (zs) 
je Ai(zy) 


where x; € I, given data (j > 1). The composition of the continuous inverse 
and direct F-transform is 


fiz 


f= 


=D Ae fir 


and in the discrete case 


= Ale ) fis 


for x € [0,00). We observe here an analogy between fuzzy transform and the 
Fourier transform, inverse fuzzy transform and Fourier series respectively. 
We will discuss here the Favard-Szasz-Mirakjan type inverse F-transform ap- 
proximation operator. We restrict F,, to any compact interval [0, b] C [0, 00). 


Theorem 13.31. (Bede-Rudas [23]) Let f : 0,00) > R be continuous and 
bounded function and let F,,(f)(«) denote the continuous inverse F-transform 
approximation operator. Then the following error estimate 


Fal) — ss ew (4, 7) | 


holds true on any compact sub-interval of [0, 00). 


Proof. Then the Korovkin-type theorems can be used. On any fixed compact 
interval we estimate the quantity 


€2 — 2e1F(e1) + Fn(e2). 
We have 


are 


Io” Ai — _ gal (i +2) 


Me) aede ALD 
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where I(x) = [> t?~te~‘dt is Euler’s gamma function. It is well known that 
T(n+1) =n!,Vn € N and we get 


i+1 
fi(e1) = ; 
Similarly 
i+1)(4+2 
flex) — GED EH2) 
n 
For the inverse F-transforms we get 
= i+1 GQ _,, (na) i 
(a)(@) = PA = Dew te 
t—1 1 


and 
i=0 
— —na \Ne a 32 9 
_ 3 ( a) ae 


As a conclusion the error is controlled by 


/ €2 — 2e1F,,(e1) + Fr(e2) (x) 


Example 13.32. In Figs. and (13.15 the approximation capabilities of 
Favard-Szdsz-Mirakjan type F-transforms are illustrated. 
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Fig. 13.14 Approximation by Favard-Szasz-Mirakjan type F-trasform. Dashed line 
= fi, solid line = inverse F-transform. 


Fig. 13.15 Approximation by Favard-Szdsz-Mirakjan type F-transform. Dashed 
line = f2, solid line = inverse F-transform. 


13.8 Problems 

1. Consider the function f : [0,1] > R, f(x) = @ and let x = £,1 = 
0,...,.2. For a fuzzy partition with triangular fuzzy numbers A;(x) 
(a1, Ui, Vi41), t= 1,...,n — 1 calculate the F-transforms f;, i = 1,...,n 
and then calculate the inverse F-transform F(x) = )\"_, Ai(a) - fi. Per- 
form detailed calculations for n = 4. 


2. Consider the function f : [0,1] + R, f(z) = x? and let x; = +,i1 =0,...,n. 
For a fuzzy partition with triangular fuzzy numbers A,(x) 


246 


Co 2 ND 


13 Fuzzy Transform 


= (#1, 2, Ui41),7 = 1,...,n—1 calculate the F-transforms f;, i = 1,...,n 
and then calculate the inverse F-transform F(x) = )°"_, Ai(x) - fi. Per- 
form detailed calculations for n = 4. 


Using the results of the previous two problems show that the error term 
in the Korovkin type Theorem [[3.27] converges to 0 as n > oo. 


. Consider the function f : [0,1] > R, f(x) = e®. Calculate the direct and 


inverse F-transform for a triangular fuzzy partition for the given function. 


Let us consider equally spaces knots y; = 4 i =0,...,n in the [0, 1] interval 
. Let us consider y_; < 0, 1 < yn41 two auxiliary knots. Let us take 


sees 


ha a ee i 


Calculate the F-transform and the inverse F-transform of the function 
f(x) =e”. Consider n = 4 as a particular case. 


Prove Proposition [13.8 
Prove Proposition [13.10 
Prove Proposition [13.12 


Starting from one of the F-transform techniques presented in the present 
chapter construct a two-dimensional F-transform. 


14 


Artificial Neural Networks and 
Neuro-Fuzzy Systems 


14.1 Artificial Neuron 


Computational Intelligence is a discipline within Artificial Intelligence and 
it studies the topics of Fuzzy Sets and Systems, Neural Networks, Genetic 
Algorithms, Swarm Intelligence and combination of these topics (see Engel- 
brecht [55]). The present chapter will present an introduction to the Theory 
of Neural Networks, and also the combination of Neural and Fuzzy systems, 
i.e., the Adaptive Network-based Fuzzy Inference System (Jang [8/]). 

A neural network is a nonlinear mapping f : R” > R™, where m,n are the 
dimensions of the input and output spaces. The building block of a neural 
network is an artificial neuron, or simply neuron. The simplest neural network 
has its input signals 7,,...,7, transformed into an output y, by propagating 
them through the synapses, with synaptic weights w1,...,Wn, with a bias b 
and an activation function y. The structure is described as in Fig. 74.1] 

The definition of a neural network in this simple form is as follows: 


Definition 14.1. A neural network is a function of the form 
where yp : R > [a,b] is an activation function, i.e., limz+—oo p(x) = a and 
limy-yo0 Y(a) = b. 


B. Bede: Mathematics of Fuzzy Sets and Fuzzy Logic, STUDFUZZ 295, pp. 247-258] 
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Fig. 14.1 The structure of an artificial neuron 


Different types of activation functions can be used in a neuron, as for example 


e Threshold function 


(gis 1 if x>0 
YP) =) 0, otherwise 
e Piecewise linear 
0 if u<-E 
p(a)=4 #(at+e) if -e<a<e 
1 if E< 2 
e Sigmoid 
(2) = — 
z)= ‘ 
o 1l+e*% 
e tanh 
p(x) = tanha. 
e etc. 


14.2 Feed-Forward Neural Network 


The simple structure in the previous section can be generalized by adding 
different layers with different entities. Feed-forward neural network archi- 
tecture has three layers: Input layer, hidden layer and output layer. The 
input layer contains the input variables of the system. The hidden layer has 
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Fig. 14.2 The structure of a feed-forward neural network with a single input 


multiple neurons. The output layer is aggregating the output that comes 
from the intermediate hidden layer with given synaptic weights. Figure [14.2 
illustrates the structure of a feed-forward neural network with a single input. 


Definition 14.2. A feed forward neural network is a function 


n 


y= >) wip (aja + b;), 


j=l 
where yp : R — [a,b] is an activation function. 


A more general case is that of a network handling multiple inputs. The inputs 
are linked to the hidden layer through different synaptic weights. In Fig. {14.3} 
a feed-forward neural network with multiple inputs is shown. 


Definition 14.3. A feed-forward neural network with multiple inputs and 
single output, is a function 


n m 
y=) wie (>. aij Xi + s] 
j=l i=1 


where yp: R > [a,b] is an activation function. 


We may have neural networks with multidimensional input and output (see 


Fig. 14.4). 
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Fig. 14.3 The structure of a feed-forward neural network with multiple inputs and 
a single output 
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Fig. 14.4 The structure of a feed-forward neural network with multiple inputs and 
a single output 


Definition 14.4. A feed-forward neural network with both multiple inputs 
zj,1=1,...,.m and outputs y,,l = 1,...,k is expressed as a function 


Y= So wy (>. Ajj X5 + s] 56 =k 
j=l i=l 


where yp: R — [a,b] is an activation function. 


Remark 14.5. Neural networks are motivated by several important 
properties: 


e Nonlinearity. Since p is a nonlinear function, it can approximate well 
nonlinear phenomena. 
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e Input output mapping. Typical inputs of the neural network should be 
mapped into typical outputs. 


e Learning. The pairs of corresponding input-output values provided in a 
given application are used for training a neural network so that it ful- 
fills the input-output mapping property. The neural network weights are 
updated according to a learning rule, to fulfill these conditions. 


e Adaptivity. A neural network is able to adapt when the input-output values 
change. 


e Fault Tolerance. A neural network is a robust system. If one single neuron 
is lost the network output does not change significantly. 


14.3. Learning of a Neural Network 


Learning of a neural network is the process of updating the synaptic weights 
such that given known inputs, propagated through the network, lead to ap- 
proximations of the desired outputs. The learning process can be supervised, 
unsupervised, reinforcement learning. 

Supervised learning provides input-output data for the network, and the 
network is adapting its weights such that the input-output mapping is real- 
ized. In an unsupervised learning no input-output data is provided for the 
network, and the network is adapting its weights such that a clustering of 
data is realized. Reinforcement learning updates the synaptic weights in such 
a way that the neurons that produce the worst output are punished (rein- 
forced). For different learning algorithms see e.g. Engelbrecht [55], Thrun 
[148]. 

Let us consider a feed-forward neural network with one hidden layer of the 
particular form 


nm 
y = >) wy (e— 23). 
j=l 


A set of training inputs @;,7 = 1,...,k, is considered and then the correspond- 
ing training (typical) outputs are §;,7 = 1,...,k. The actual output is 
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We have 
k k 


oF = 27 (0% — §i) itis 290 (0% — ile (i — 5). 


Ow; i=1 i=l 


The basic algorithm for the learning process of a neural network is the gra- 
dient descent algorithm. It is described as follows: 


e Step 1. Assume random synaptic weights w;,j7 =1,...,k and € > 0. 


e Step 2. Calculate the actual outputs given the training data, 
n 
ou = S- WIP (4; = xj) 
j=l 


e Step 3. Update the synaptic weights 


iter OE 


iter+1 _ —7n 
t a Owiier 


W W 


e Step 4. If the error 
k 


K= Se — 4%)? >e 


i=1 


and if a maximal number of iterations is not attained then go to step 2. 


Gradient descent algorithm can be used as the learning algorithm for the 
synaptic weights in the hidden layer. Let 


n m 
y= S- WP (>. AjjXi + ] 5 
j=l i=1 


be a feed-forward network. We assume given training data %;,,y,! = 1,...,k, 
i =1,...,m. The error function is 


We will find the gradient. We have 


aE .. do 
= 2) {er = 5a, ; 


Oa; 
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dE z dy 
=2 s — H)wjyz-fu, 
Oa; (or yw; du ii 


i=1 


where fe can be calculated based on the activation function. If y is the 


sigmoid function then we have 


OE 
Oai; 


k 
= 2S (or — )o(1 os of. 


i=1 


This is based on the fact that for the sigmoid function y we have y’(u) = 
p(u)(1 — g(u)). 

If vy is the threshold function then this partial derivative is always 0. This 
is not a convenient result, so in this case we need a different learning rule. In 
this case the derivative te is replaced by the approximation 0;(1 — 0). So we 


UW 
have the same expression 


OE 
Oui; 


k 
= 25° (or = )o(1 = oh. 


i=1 


14.4 Approximation Properties of Neural Networks 


We denote by C[0,1] the space of continuous functions endowed with the 
uniform norm. We will show that any continuous function can be uniformly 
approximated by neural networks using a constructive approach. Let 0 = 
Lp Say <<... < By < Ln41 = 1 be a partition with equally spaces points and 
f € C[0,1]. We define the neural network 


Nnf (2) = So wit(a — 2), 
i=0 


where 7 is the threshold function and 


a-1 


w, = MLD Sy, 
j=0 
with 
x(fii)= sup f(x)+ inf f(z), i=0,..,0 


ve [x ;,0i41) v€ [vi ,@i41) 


Theorem 14.6. (see Csdji [40])The following error estimate holds true 


1 
Wf — Naf < Ea, 
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Proof. As the first step of the proof we will show that N,, f(x) = Ft) 
Indeed, if w € [a#;, 7441) then 


n i-1 
Nnf (x) = So wit (a — x)= Sou; + Wi 
i=0 j=0 


i-1 4 i-1 F 
x(f, 1) x(f, 2) 
= ww, + — oy = ——, 


Now we turn our attention to the estimate. First we observe that 


w (nz) = sup ise) 20) = sup fle) int FC) 


[wi,@i41) ve [x;,0i41) ve [xi ,@i41) 
= sup f(z)— xf #) as xt) _ inf f(x) 
ve [xi,vi+1) 2 2 vet; ,Li41) 
i dae. ley x(f, 4) 
ve [e;,0i41) 2 


Now, for & € [a;, %i41) 


sup (fla) —Naf(o)|=__ sup [y(e) -ME9) < Su (4,2) 


ve [xi ,vi41) ve [x;,0i41) 


and as a conclusion we get 


ee ee 


Corollary 14.7. If f is continuous then limn+o Nnf (x) = f(z). 


The theorem can be extended to the case of sigmoid activation function 
(Cybenko [41]) and other neural networks (Anastassiou [3]). 


Example 14.8. Let us consider the function f; = e~% sin2x. Its neural 
network approximation is given in Fig. 


14.5 Adaptive Network Based Fuzzy Inference System 
(ANFIS) 


An adaptive network based fuzzy inference system (ANFIS Jang [81]) is able 
to combine a fuzzy system’s ability to model a reasoning process and to handle 
uncertainty, with the learning ability and adaptivity of a neural network. 
ANFIS is based on a Takagi-Sugeno fuzzy system. Let us consider an example 
of a Takagi Sugeno fuzzy system with a single input and output and n fuzzy 
rules. 
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Fig. 14.5 Approximation by a neural network. Dashed line f; and solid line =neural 
network 


e Rule 1: If # is Ay then fy = ppx + ry 


e Rule n: If x is Ay, then fp = pnt +Tn 


The architecture of the ANFIS is as in Fig. [14.6 
The layers are described as follows: 


e The input layer receives data x. 
e Layer 1: The membership grades Aj(x), Ao(a),...,An(x) are calculated. 
e Layer 2: The firing levels of the fuzzy rules, namely 
wy, = Ay(x) ... Wn = An(Z) 
are calculated. 


e Layer 3: Normalized firing levels 


Wi Wn 


w, = —————__ and uw}, = ————_ 
Wy +... t+ Wn Wy +t... + Wn 
are calculated. 


e Layer 4: The individual output of each fuzzy rule can now be calculated 
as 
wifi = wipe t+r1), 


Wrfn = Wh (Pn& + Tn)- 
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oP el 


Fig. 14.6 The structure of a feedforward neural network with a single inputs and 
a single output 


e Layer 5: The individual outputs of the rules are combined 


f=) vile tri). 


i=l 


e The output layer has outcome f. 


The difference between ANFIS and a Takagi-Sugeno system is that the weights, 
and the membership functions in ANFIS are learned through an optimization 
algorithm. Surely, as Takagi-Sugeno systems without an added optimization 
are approximation operators, the ANFIS system will be able to approximate 
any continuous function. 

Let us consider an example of a Takagi Sugeno fuzzy system with two 
linguistic antecedents, and two fuzzy rules. 


e Rule 1: If is A; and y is B, then fy =mat+tqaytrn 


e Rule 2: If a is Ag and y is Bg then fo = pox + qay tre 


The architecture of the ANFIS is as in Fig. [14.7] 
The layers are described as follows: 


e The input layer receives data x, y. 


e Layer 1: The membership grades A;(x), Ag(a) and By(x), Bo(x) are cal- 
culated. (A;, B;, are given fuzzy sets). 


e Layer 2: The firing levels of the fuzzy rules, namely 
w, = Ai(a)- Bi(y) and we = Ao(x) - Bo(y) 


are calculated. 
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Fig. 14.7 The structure of a feedforward neural network with multiple inputs and 
a single output 


e Layer 3: Normalized firing levels 


/ 
Wy 


l| 
iS) 
B 
a 
RS 
l| 


are calculated. 
e Layer 4: The individual output of each fuzzy rule can now be calculated 
as 
wifi = wi (pie + ny +71) 


and 


Wa fo = We (per + qy +12) 
e Layer 5: The individual outputs of the two rules are combined 
f=wi fit wofe = wipe + ay +71) + we(per + gy +12) 
e The output layer has outcome f. 


The learning of an ANFIS can adaptively derive the coefficient values py, po, 
1, 92,71, 72 using a least squares method. Also, parameters of the fuzzy sets 
A, Ag, Bi, Bz can be determined or adjusted by a suitable learning algo- 
rithm. This improves the flexibility and adaptability of the network. 

Let us describe for example the learning algorithm for the parameter p). 
The Error function can be written 


where 2;,9;,2j;,j = 1,...,n is training data. Then 


258 14 Artificial Neural Networks and Neuro-Fuzzy Systems 
The gradient descent algorithm is then the usual one 


OE 
peer a al = Napier ; 


As an immediate consequence of Theorem [7.30] we obtain that the ANFIS 
system can approximate any continuous function with any accuracy, moreover 
the order of approximation is at least the same as in Theorem [7.30] Indeed, 
ANFIS is in essence a particular case of a Takagi-Sugeno fuzzy system. ANFIS 
is a fuzzy system with a neural network used to perform its optimization 
adaptation. ANFIS is not a neural network in the strict meaning of Definitions 
[14.1] or [£4.3] Surely the idea of adaptivity combined with that of fuzziness 
makes the system very useful and extremely powerful in applications. 


14.6 Problems 


1. Consider the Neural Network 


with y(a) = Te a > 0 being a parameter. Deduce learning rules for 
the synaptic weights wz; , ai;- 


2. Repeat the previous problem with the activation function y(#) = tanh x. 


3. Consider 
—1 if oF 
p(z)=4 sing if -$<a<f 
1 if a se 


Show that y is an activation function and use this function to construct 
a neural network with one hidden layer. Describe learning rules for the 
given network. 


4. Given v(x) an activation function prove that y(ax) with a > 0 is also an 
activation function. Use this method to construct neural networks with 
variants of tanh and sin as given above. 


5. Prove that ANFIS can approximate any continuous function based on 


Theorem [7.30] 
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Appendix A 
Mathematical Prerequisites 


In the present Appendix we recall a few basic definitions and theorems from 
Mathematics, especially Mathematical Analysis, that are used throughout 
the text. This is not intended to be an exhaustive treatise or a replacement 
of a solid mathematics background for students, instead we will concentrate 
on results cited in the text in an effort to make the text more independent. 


A.1 Lattices 


Let L be a set and < be a relation (classical relation) on L. 


Definition A.1. A classical relation is said to be a partial order on L if it 
18: 

(i) reflexive, i.e.,a<a,VaeL 

(ii) antisymmetric, i.e., ifa<bandb<a thena=b,a,beE L 

(iit) transitive i.e., ifa<bandb<c thena<c,a,b,cE L 

We say that L is a partially ordered set (poset). 


Example A.2. As examples of partial orders we mention: < the standard 
inequality of real numbers, C inclusion of classical sets or fuzzy sets, | divis- 
ibility of integers, etc. 


Let us recall the following general definition of the infimum and supremum. 


Definition A.3. (i) The greatest lower bound (infimum) of two elements a, b 
of a poset L is an element c € L such that c < a,c < b and for any dc <a 
and c <b we have c’ < c. We denote c = inf{a,b} orc=adz b. 
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(ii) The least upper bound (supremum) of two elements a,b of a poset L 
is an element d € L such thata <d, b<d and for anya<d' andb<d' we 
have d < d'. We denote d = sup{a,b} orc=aV_z b. 

(iit) The greatest lower bound (infimum) of a nonempty subset A C L is 
ce Life<2,V2€ A and ifc € L is such that Cc <a2,Vx € A thenc <c. 

(iv) The least upper bound (supremum) of a nonempty subset A C L is 
de Lifa<d,VxeEA and ifd' € L is such thatx <d',Vx€ A thend<d. 


One of the possible ways to define a lattice is the following. 


Definition A.4. We say that a partially ordered set L is a lattice if any two 
elements in L have a supremum and an infimum. 


A lattice can also be defined based on interpretation of the inf and sup as 
algebraic operations. 


Example A.5. (R,<), (N,|), (P(X), C) are lattices. In (R, <) the infimum 
is the minimum and supremum coincides with the maximum. In (N,|) the 
infimum of two elements a,b is their greatest common divisor, while their 
supremum is their least common multiple. 


If the inf and sup operations are distributive w.r.t. each-other then we call 
the lattice a distributive lattice. 


Definition A.6. A complete lattice is a partially ordered set (L,<), such 
that any non-empty subset of L has an infimum and a supremum. 


Definition A.7. A lattice L is called completely distributive if 


al (V+) =\andi 


1EL iel 


and 
aV (A») - \av bi 
i€l i€l 
hold Va,b; € L,i€ I and I any index set. 
Example A.8. ([0,1],<) is a complete, completely distributive lattice. 


The next theorems are due to Tarski-Knaster and Kleene respectively (see 


e.g. Tarski [144]) 


Theorem A.9. Let L be a complete lattice and f : L + L be a monotonic 
function. If the set {x € L|f (x) < x} a € Llu < f(x)}) ts non-empty, then 
the set of fixed points forms a complete lattice and f has a least (greatest) 
fited point x, € L (a* € L). 
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Theorem A.10. Let L be a complete lattice having first and last element 
that is 50,1 EL, i.e. 0<a,Va€ L anda <1,Var € L) and let f : L + L be 
<-continuous (i.e., f is such that for cy < cg <...< en <... we have 


Vsted=4 (Ven): 


n=1 


Then the least and greatest fixed points satisfy 
te = VV f"(0), a = f\ fF"), 
n=1 n=1 


where f” means here n times composition of f by f. 


A.2 Real Numbers 


Definition A.11. We consider a field R (i.e., a set endowed with additive 
and multiplicative operation with certain properties), with a total order rela- 
tion (reflexive, transitive, antisymmetric relation, such that any two elements 
are comparable) compatible with the operations. If additionally R has the least 
upper bound property then R is called the real numbers set, and its elements 
are called real numbers. 


The least upper bound property is an axiom of the real-numbers and it is 
used throughout the text. 


Axiom A.12. (Least Upper Bound property) Any nonempty set A C R 
bounded from above (i.e., if there exists M © R with « < M,Va € A), has a 
supremum (least upper bound). 


Dually any nonempty set bounded from below (i.e., if there exists m € R 
with m < x,Va € A) will have an infimum (greatest lower bound). 


A.3 Metric Spaces 


Let us recall here the definition of a metric space. 


Definition A.13. Let X be a set andd: X x X — [0,c) be a function. 
The function d is called a metric on X (and in this case X is called a metric 
space) if the following properties are fulfilled. 

(i) d(x,y) > 0,Va,y € X with d(x, y) = 0 if and only if x = y. 

(ii) d(a, y) = d(y, x), Va, y € X 

(iii) d(x, z) < d(x,y + d(y, z), Vz, y, 2 © X. 


As examples of metric spaces let us mention R” with e.g. Euclidean distance 
which in the one-dimensional case becomes d(x, y) = |x — y|. 


270 Appendix A Mathematical Prerequisites 


Definition A.14. A sequence (%n)n>0 C X is said to converge tox € X if 
Ve > 0 there exist N(e) > 0 such that d(an,x) <¢,Vn > N(e). 


Definition A.15. A sequence (%n)n>0 C I is fundamental if Ve > 0 there 
exist N(e) > 0 such that d(tn,tn4p) <€,Vn > N(e),p> 1. 


Definition A.16. A metric space is complete if any fundamental sequence 
converges. 


The Euclidean space R” and in particular R are complete metric spaces. 
Pp 


Definition A.17. An open ball centered at xp and radius r in a metric space 
X is 
B(xo,r) ={a € X|d(x, x9) < r}. 


A closed ball in a metric space is defined as 


B(ao,r) = {x € X|d(x, x0) <r}. 


A set V C X is a neighborhood of x € X if it contains an open ball x € 
B(x,r) CV. A set A C X is open if it is a neighborhood of every of its 
points. 


An important property is that arbitrary unions of open sets are open. 
Definition A.18. A set is closed if its complement is open. 


Sets may be closed and open simultaneously, so the concepts of open and 
closed set do not exclude each-other. 


Proposition A.19. A set A C X is closed if and only if any convergent 
sequence (Ln)n>0 C A converges tox € A. 


Definition A.20. The closure of a set is the least closed set (in the sense of 
the inclusion) that contains the set. 


The closure of a set consists of all the points of the set and the limits of all 
sequences with terms in the set. For example the closure of the set of rational 
numbers Q is the set of real numbers R. The notation cl(A) is used to denote 
the closure of the set A. 


Definition A.21. A subset A C X is said to be compact if from any covering 
AC Uier U; with open sets we can extract a finite sub-covering A C er U;. 


A compact set must be closed. A subset of a metric space is compact if and 
only if it is sequentially compact (i.e, any bounded sequence has a convergent 
subsequence). Also, a subset A of a complete metric space is compact if and 
only if it is totally bounded, i.e. Vr > 0 we can cover A with finitely many 
open balls B(2;,7r),2 =1,..,n with the radius r. 


Theorem A.22. (Heine-Borel) A subset A C R” is compact if and only if 
it is closed and bounded. 
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A Lindel6f space is a generalization of the concept of compactness. 


Definition A.23. A subset A C X is said to be Lindeléf if from any covering 
AC Ley U; with open sets we can extract a countable sub-covering A C 


Usa Ui. 
Separability is another important property. 


Definition A.24. A metric space X is said to be separable if it is the closure 
of a countable subset A C X. 


If a space is compact then it is also separable. For example R is separable 
being the closure of Q. 
Another important property is convexity. 


Definition A.25. A subset A C R” is said to be convex if for any x,y € A 
we have Ax + (1— A)y € A. 


A subset of R is a closed interval if and only if it is both compact and convex. 


A.4 Continuity 


Definition A.26. A function f : X > Y is continuous at x € X if for any 
neighborhood V of f(a) we can find a neighborhood U of x with f(U) CV. 


Equivalently we can formulate continuity using the distances on X and Y. 


Proposition A.27. A function f : X > Y is continuous atx € X if for any 
€ > 0 there exists 6 > 0 such that do(f(y), f(x)) < € whenever di(x,y) < 6. 
If it is continuous for every value of x € X then we say it is continuous on 
X. (We denote the distance on X by d, and the distance on Y by dz.) 


Continuity and compactness work together in the following way. 


Proposition A.28. The image of a compact set K C X through a continu- 
ous function f : X + Y (X,Y metric spaces) is compact. 


The space of all continuous functions f : K — Y on a compact metric space 
K, with Y being a metric space, is denoted by C(K,Y). On C(K,Y) we can 
define the metric 


D(f,g) = sup (f(x), f(g), 


cek 


and then the function space itself will become a metric space. The metric D 

on C(K, Y) is called the uniform distance. If additionally Y is complete then 

C(K,Y) is a complete metric space with respect to the uniform distance. 
Upper semicontinuity is used when we define fuzzy numbers. 


Definition A.29. A function f : X > R (X being a metric space) is upper 
semicontinuous at xo if Ve > 0 there exists 6 > 0 such that f(x) < f(xo) +e 
for d(x, y) <6. 
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Theorem A.30. A function is upper semicontinuous if and only if the sets 
{xe X|f(xz) <a}l,aeR 

are open, or equivalently if the sets 
{x eE X|f(x) > as,aeR 


are closed. 


Definition A.31. A function f : X > R (X being a metric space) is lower 
semicontinuous at xo if Ve > 0 there exists 6 > 0 such that f(x) > f(ao) —€ 
for d(x, y) <6. 


Theorem A.32. A function is lower semicontinuous if and only if the sets 
{xe X|f(x) < a}t,aeR 

are closed, or equivalently if the sets 
{xe X|f(x) > a},aeR 


are open. 


If a function is both upper and lower semicontinuous then it is continuous. 
Left and right continuity appear in a characterization theorem. 


Definition A.33. A function f :R—-R is right continuous at xo if Ve > 0 
there exists 6 > 0 such that |f(x) — f(xo)| < € forro <x < aot. 


Definition A.34. A function f :R — R is left continuous at xo if Ve > 0 
there exists 6 > 0 such that |f(x) — f(x0)| < € forro9 —-6 < @ < QO. 


If a function is both left and right continuous then it is continuous. 


Definition A.35. Let (X,d1), (Y,d2) be metric spaces. A function f :X > 
Y is of Lipschitz type if there exists L such that d2(f(x), f(y)) < Ldi(z,y), 
Va,yEe xX. 


Definition A.36. Let (X,d) be a metric space. A function f : X > X is 
a contraction if there exists 0 <q < 1 such that d(f(x), f(y)) < qd(z,y), 
Va,yEe xX. 


Theorem A.37. (Banach fixed point theorem) Let (X,d) be a complete met- 
ric space. Any contraction f : X + X has a unique fixed point, i.e., there 
exists a unique x, € X such that f(a.) = vs. 


A.5 Modulus of Continuity 


The modulus of continuity is often used in the text so, let us recall its defi- 
nition and main properties. 
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Definition A.38. Let (X,d) be a compact metric space and ([0,00),|-|) the 
metric space of positive reals endowed with the usual Euclidean distance. Let 
f : X — [0,00) be bounded. Then the function 


w(f,-) : [0, co) = [0, co), 


defined by 


w(f,6)=V {lf (@ -—f@)a.yeX, d(w,y) < 5} 


is called the modulus of continuity of f. 


Theorem A.39. The following properties hold true 

i) 

If (2) — f(y) |< (f,d(z,y)) 

for any x,y € X; 

ii) w(f,d) is nondecreasing in 6; 

iii) w (f,0) = 0; 

iv) 

w (f, 41 + 62) < w (f, 41) +w(f,62) 

for any O1, da, € (0, 00); 

v) 

w(f,nd) < nw (f, 6) 


for any 6 € [0,0c0) andn € N; 


vt) 
w(f,rd) < (A+ 1) -w (F,9) 


for any 6, € [0, 00); 
ult) f is continuous if and only if 


lim w (f,0) = 0. 


A.6 Normed Spaces 


Definition A.40. Consider a linear space X. A norm is a function ||-|| : 
X — (0,00) having the following properties. 

1) ||z|| > 0,Va € X and ||x|| = 0 if and only if x = 0. 

2) \|Ax|| = Al |la|],.VA € Ry a eX. 

3) || + yl] < llall + llyll Vay € X, 

In this case the space X is called a normed linear space or simply a normed 
space. 


The norm induces on X a metric structure with the distance being d(x, y) = 
lla — yl. 
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Definition A.41. If a normed space is a complete metric space with the 
induced metric, then it is called a Banach space. 


We denote by C([a,b]) the space of continuous functions f : [a,b] > R with 
the uniform norm || f|| = sup,¢ja,j|f(x)|. Then C((a, 6]) is a Banch space. 
Also, let £(C([a,b])) be the space of linear operators T : C({a,b]) > 
C([a, b]). Inequality between functions is considered point-wise, i.e., f < g if 
f(x) < g(a) for any x € [a,b]. In particular we say that f > 0 if f(a) > 0 for 
every x € [a, b]. 
An operator is said to be positive if T(f) > 0 whenever f > 0. 


Index 


Archimedean t-conorm fuzzy number 
Archimedean t-norm [19] fuzzy relation B3] 
fuzzy Riemann integral [154] 
compactly supported [51] fuzzy rule 
complement [6] fuzzy rule base [83] [84] 
compositional rule of inference [86] fuzzy set [2] 
core fuzzy union [6] 
De Morgan triplet g-difference 
defuzzification [I07] Gédel implication [38] 
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